DEVOURED
Gal Yona, Mor Geva, and Yossi Matias argue that LLMs hallucinate because they can't express uncertainty, not because they lack knowledge, proposing 'metacognition' as the solution in an ICML 2026 position paper.
What: Researchers Gal Yona, Mor Geva, and Yossi Matias published an ICML 2026 position paper (arXiv:2605.01428, submitted May 2, 2026) reframing hallucinations as 'confident errors'—incorrect information delivered without qualification. They argue factuality gains in LLMs come from expanding knowledge boundaries rather than improving awareness of those boundaries, and propose 'faithful uncertainty'—aligning linguistic uncertainty with intrinsic uncertainty—as the path forward.
Why it matters: This represents a conceptual shift in tackling LLM reliability: instead of forcing models to know more facts or abstain when uncertain, the focus moves to honest uncertainty communication. For agentic systems, this becomes the control layer governing when to search externally and what to trust, making metacognition essential for both trustworthiness and capability.
Deep dive
- LLMs continue to hallucinate even on simple factoid question-answering despite advances in factual reliability
- Most factuality gains come from expanding the model's knowledge boundary (encoding more facts) rather than improving awareness of that boundary (distinguishing known from unknown)
- Models may inherently lack the discriminative power to perfectly separate truths from errors, creating an unavoidable tradeoff between eliminating hallucinations and preserving utility
- Traditional approaches present an answer-or-abstain dichotomy when facing uncertain queries
- Reframing: hallucinations are confident errors—incorrect information delivered without appropriate qualification or hedging
- Proposed solution: faithful uncertainty—aligning the linguistic expression of uncertainty with the model's intrinsic uncertainty about the answer
- This is one facet of metacognition: the ability to be aware of one's own uncertainty and to act on that awareness
- For direct human interaction, metacognition means communicating uncertainty honestly through qualified language
- For agentic systems, metacognition becomes the control layer that determines when to invoke external search and which sources to trust
- The authors position metacognition as essential for LLMs to be both trustworthy (by not confidently stating errors) and capable (by not over-abstaining)
- The paper concludes by highlighting open research problems needed to make progress toward metacognitive LLMs
Original article
The paper reframed hallucinations as failures to express uncertainty rather than gaps in knowledge, proposing “faithful uncertainty” as a mechanism for aligning model confidence with actual reliability.
Explore all 66 articles in today's digest
Fresh dev news, AI-digested daily. Never miss a trend at devoured.fyi