Back to blog
EXPERTISEKNOWLEDGESKILLS

AI Has Created a New Kind of Expert

Fluent, confident, and thin. What happens when the expertise signal stops working.

10 min read
An empty lectern on a lit stage with a microphone and a glass of water in a dark auditorium
Sounding like an expert has never been easier.

There is a person I keep encountering in professional settings who did not exist quite like this before AI. They are knowledgeable in a specific, surface-saturation way: they can speak at length and with apparent fluency about topics that they have not meaningfully studied, drawing on AI-generated summaries that give them the vocabulary, the conceptual scaffolding, and the confident tone of someone who knows. Ask them a question the summary anticipated and they answer beautifully. Ask them one it did not and something quietly gives way.

I want to name this phenomenon clearly rather than euphemistically: AI is enabling a specific form of intellectual imposture that is new in its scale and its seamlessness. Not because AI tools are uniquely suited to producing dishonesty, but because the combination of fluent language generation and the widescale availability of plausible-sounding knowledge synthesis makes the presentation of surface-level understanding as genuine expertise significantly easier and significantly more convincing than it was in the pre-AI world. The confident amateur has always existed. AI has dramatically lowered the threshold of knowledge and effort required to become one, and has substantially raised the quality of the performance they can produce.

This is a genuine social problem, and I want to be careful about how I frame it. The concern is not primarily about individual dishonesty, though that is part of it. The deeper concern is about the collective degradation of the expertise signal: the progressive difficulty of distinguishing between people who genuinely know what they are talking about and people who have AI-generated the appearance of knowing. When that signal degrades, the mechanisms through which society allocates the responsibility for consequential decisions to people who are actually equipped to make them break down.

A shallow painted stage flat propped up from behind revealing bare timber supports
Depth on demand, with nothing holding it up.

Understanding what makes the AI-enabled confident amateur different from previous versions of intellectual imposture requires understanding what AI provides that was not previously available. The previous version of the confident amateur was limited by the fact that producing plausible-sounding technical content required actually understanding enough to write it coherently: the Dunning-Kruger trap eventually closed on them when they were asked to go deeper than they could. AI changes this by providing unlimited depth on demand. The confident amateur who is challenged on a specific point can ask AI to generate a more detailed response, producing the appearance of depth that genuine expertise would provide without having developed that depth themselves.

There is also the vocabulary capture effect: AI provides the specific terminology and conceptual frameworks of a field in accessible, well-explained form, giving the confident amateur the linguistic tools to participate in specialist conversations in ways that previously required extensive study. The clinician who has spent years learning the vocabulary of epidemiology, the lawyer who has built an understanding of contract law through years of practice, the engineer who has developed intuition about structural mechanics through repeated application: all of them now face professional conversations with people who have acquired the surface vocabulary through AI-generated explanations without the underlying understanding. The vocabulary is the same. The understanding it represents is not.

The third dimension of the confident amateur is the AI-enhanced confidence itself. Large language models produce confident, well-structured prose. People who absorb and re-deliver that prose tend to absorb the confidence with it. There is also a genuine cognitive effect: having a fluent AI-generated explanation of something creates the feeling of understanding that cognitive psychology identifies as the feeling of knowing, which is a good proxy for genuine understanding in normal circumstances and a poor proxy in AI-assisted circumstances. The person who has read a well-written AI summary of a complex topic may genuinely feel as though they understand it, not just presenting themselves as understanding it. The subjective experience of confident superficial understanding is more convincing than deliberate deception, and it is harder to catch.

A worn set of professional hand tools laid out on a scarred workbench in low workshop light
The people who actually do the work pay for this.

The people who bear the costs of the confident amateur phenomenon are not primarily the amateurs themselves, who may never be fully exposed. The costs fall primarily on the genuine practitioners, who find themselves in professional environments where the baseline of apparent knowledge has risen without the baseline of actual judgment rising with it, and where the signals they previously used to distinguish serious from superficial engagement with a topic are being systematically mimicked.

The experienced practitioner has developed a specific set of signals for identifying genuine engagement with a field: the specific questions a knowledgeable person asks, the particular ways their knowledge is uneven in ways that reflect how they actually learned it, the discomforts and uncertainties they acknowledge that only someone who has tried to apply the knowledge knows are real, the specific ways they are wrong that are characteristic of a certain stage of genuine development. AI-enabled confident amateurs can mimic some of these signals and cannot easily mimic others, and learning to distinguish the ones that can be mimicked from the ones that cannot is becoming an increasingly important professional skill for practitioners who need to evaluate the actual knowledge levels of the people they are working with.

The social cost of degraded expertise signals extends beyond individual professional contexts into the institutions and trust relationships that depend on them. When patients cannot rely on the credentials of people presenting as healthcare experts to indicate genuine competence, the healthcare system's ability to deliver appropriate care is undermined. When organisations cannot rely on the apparent expertise of consultants and advisors to indicate genuine understanding, the quality of the decisions those advisors inform deteriorates. When public discourse cannot distinguish between people who have genuinely developed expertise in complex domains and people who have AI-generated the appearance of it, the quality of collective decision-making on complex issues, which depends on genuine expertise being identifiable and appropriately weighted, declines.

A brass jeweller's loupe resting on a velvet cloth beside a single uncut stone
The tells that are hard to fake are the ones worth learning.

The practical challenge of rebuilding the expertise signal in a world where AI enables the confident amateur requires identifying the specific markers of genuine expertise that are most resistant to mimicry and investing in making those markers more legible in professional contexts. The markers that are hardest for AI-enabled amateurs to fake are those that require genuine experiential knowledge: the specific ways a practitioner is uncertain that reflects their actual engagement with the problem, the particular aspects of a topic they cannot explain because their understanding developed in a way that left gaps only experience fills, the characteristic errors of someone who has genuinely tried to apply knowledge in practice.

Verification practices that specifically probe these harder-to-fake markers are worth developing explicitly in professional contexts where the expertise signal matters. Asking for specific, practical examples rather than general principles. Asking what has gone wrong in their experience of applying this knowledge and what they learned from it. Asking what they do not know rather than what they do. Asking them to explain something without using the standard vocabulary of the field. These approaches are not foolproof, but they shift the ground to territory where genuine experience matters more than AI-generated summaries.

The longer-term response requires changes in how expertise is credentialed, communicated, and valued in professional contexts. Credentials that specifically certify practical experience rather than knowledge acquisition become more valuable when AI makes knowledge acquisition easy. Portfolio-based demonstrations of applied judgment become more legible than examination results when examination performance can be AI-assisted. Reputation systems that track track records of real-world application become more informative when they can be distinguished from reputations built on confident amateur performance. None of these are simple changes, but they represent the direction in which the expertise signal needs to evolve if it is to remain informative in a world where AI has dramatically lowered the cost of appearing to be an expert.

EXPERTISEKNOWLEDGESKILLSTRUSTPROFESSIONS

Topics in this article