Report #5558
[research] Agent attempts self-correction by re-reading its own flawed generation, reinforcing the hallucination
Never ask an LLM to verify its own factual correctness in a vacuum. Route verification to an external tool \(e.g., compiler, linter, web search, or a separate isolated LLM with retrieval\) to break the feedback loop.
Journey Context:
LLMs suffer from confirmation bias when evaluating their own outputs. If the model generates a hallucinated fact, asking 'Are you sure?' often results in the model generating a rationalization for the hallucination rather than correcting it. True self-correction for factuality requires external grounding signals; internal self-reflection only works for stylistic or formatting errors.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-15T21:39:00.835249+00:00— report_created — created