Feature Proposal: AI-Mediated Idea Analysis and Human Expertise Routing
Summary
Many valuable ideas emerge naturally during conversations with AI assistants, but most remain private and disappear with the conversation.
The problem is not only that ideas are difficult to submit. A deeper problem is that, when an idea reaches a human evaluator, its fate may depend heavily on whether that particular person has the expertise, perspective, time, or cognitive framework required to evaluate it.
I propose an optional, consent-based system in which AI does not decide whether an idea is correct or valuable. Instead, AI analyzes the idea, identifies its characteristics and implications, and helps route it to the people most capable of evaluating it.
The system could then learn from the outcomes of human evaluations to improve future routing.
The Core Principle
AI should not replace human judgment. It should improve the connection between ideas and human judgment.
An AI system should distinguish between:
-
analyzing an idea,
-
judging an idea,
-
and selecting an appropriate person to judge the idea.
These are different tasks.
The proposed system gives AI responsibility for the first and third tasks while preserving the second for humans.
Proposed Workflow
1. Idea Recognition
During a conversation, ChatGPT may recognize that the discussion contains a potentially useful product idea, research hypothesis, workflow improvement, or other generalizable proposal.
This should be entirely optional and user-controlled.
For example:
“This conversation appears to contain a potentially useful product or research idea. Would you like me to prepare it as a standalone proposal?”
Nothing should be submitted automatically.
2. AI Analysis Without Judgment
With user permission, an AI system extracts the idea from the conversation and produces a structured analysis.
Possible fields:
-
Problem being addressed
-
Proposed solution
-
Assumptions
-
Logical consequences
-
Advantages
-
Disadvantages
-
Risks
-
Required technologies
-
Potential impact
-
Areas of uncertainty
-
Conflicts with existing approaches
-
Potentially novel aspects
-
Questions requiring human evaluation
Importantly, the AI should avoid reducing the proposal to a binary:
“Good idea / Bad idea”
Instead, it should expose the reasoning necessary for another party to make that judgment.
3. Detecting Paradigm Conflict
A potentially important signal should be whether an idea conflicts with an existing paradigm.
The system should distinguish between:
“This idea contains a logical contradiction.”
and:
“This idea contradicts the assumptions of the current system.”
These are not necessarily the same thing.
An idea that appears unusual or incompatible with existing practice should therefore not automatically receive a negative score.
Instead, it could be flagged for additional review.
This would reduce the risk of rejecting potentially valuable ideas simply because they do not fit established frameworks.
4. Independent AI Routing
A second AI system could independently examine the proposal and ask:
“Who is best positioned to evaluate this idea?”
The routing model should consider the characteristics of the idea rather than simply relying on the first AI’s recommendation.
For example, a proposal may require:
-
domain expertise,
-
cost-benefit analysis,
-
technical knowledge,
-
unconventional thinking,
-
regulatory knowledge,
-
practical implementation experience,
-
or a combination of several disciplines.
The output would therefore be an expertise profile, not a simple category.
5. Learning From Human Evaluators
The system could maintain anonymized, task-specific performance signals for participating evaluators.
For example:
| Topic / Task Type | Evaluator A | Evaluator B | Evaluator C |
|---|---|---|---|
| Botany-related proposals | 9.9 | 6.2 | 7.1 |
| Cost-benefit analysis | 7.1 | 9.8 | 8.4 |
| Novel/unconventional proposals | 8.3 | 7.9 | 9.7 |
When a new proposal arrives, the routing AI could use this information.
Importantly, this should not mean:
“Evaluator A is a better human.”
It should mean:
“Evaluator A has demonstrated stronger performance on this particular class of problems.”
The system could also account for:
-
number of evaluations,
-
confidence intervals,
-
task similarity,
-
historical accuracy,
-
evaluator calibration,
-
and performance on novel rather than repetitive problems.
6. The Feedback Loop
The system could continuously improve:
Idea
↓
AI analysis
↓
AI expertise matching
↓
Human evaluation
↓
Evaluation outcome
↓
Anonymized performance signal
↓
Improved future routing
This creates a learning system whose objective is not merely to identify “good ideas,” but to increasingly improve the probability that each idea reaches an appropriate evaluator.
Why This Matters
Human evaluation is inherently dependent on context.
The same idea can receive very different evaluations depending on:
-
who reads it,
-
what that person knows,
-
what assumptions they hold,
-
how familiar they are with the relevant domain,
-
how much time they have,
-
and whether they are comfortable challenging established assumptions.
A potentially valuable idea may therefore disappear not because it is wrong, but because it reached the wrong evaluator.
The system should attempt to reduce this dependency.
A More General Objective
The goal is not:
“Find the smartest person.”
It is:
“Find the person most capable of evaluating this particular kind of problem.”
This distinction allows the system to recognize different forms of expertise.
For example, someone may be exceptionally good at:
-
detecting technical flaws,
-
evaluating economic feasibility,
-
identifying hidden assumptions,
-
recognizing paradigm shifts,
-
or converting abstract ideas into practical implementations.
These are different capabilities.
Human Authority Remains Intact
The system should not make the final decision.
The final decision remains with humans.
AI acts as:
-
An analytical layer that structures the idea.
-
A routing layer that identifies suitable evaluators.
-
A learning layer that improves future routing from evaluation outcomes.
It does not become the authority that determines whether an idea deserves to exist.
Privacy and Consent
The system should be explicitly opt-in.
A user should be able to:
-
approve the extracted proposal before sharing,
-
edit or delete any part of it,
-
remove personal context,
-
remove sensitive information,
-
choose whether the proposal is shared externally,
-
and see exactly what information will be transmitted.
Ideally, the system should separate:
the idea
from
the identity and personal context of the person who generated it.
For example, an AI could extract a general product concept from a long personal conversation while removing unrelated personal, financial, medical, legal, or identifying information.
The Larger Concept
This is not primarily a system for collecting feature requests.
It is a possible architecture for preserving and routing human-generated knowledge.
AI assistants are increasingly becoming places where people think, explore hypotheses, solve problems, and develop ideas.
A large amount of potentially useful intellectual output may therefore accumulate inside private conversations.
The missing layer is a mechanism that can optionally transform:
private conversation → structured idea → independent analysis → appropriate human evaluator → feedback → improved routing
without requiring the user to understand how institutional feedback systems work.
Guiding Principle
AI should not decide which ideas deserve to survive.
AI should help prevent ideas from being lost simply because they reached the wrong person.
That may be a more valuable role for AI than replacing human judgment:
preserving the connection between human ideas and the humans most capable of developing them.