Report #22320
[counterintuitive] RAG fixes hallucination
Treat RAG as context augmentation, not a hallucination cure. Implement citation verification and explicitly instruct the agent to state 'Insufficient context' rather than synthesizing an answer from partial or irrelevant matches.
Journey Context:
The belief is that giving the agent documents will ground it. In reality, models suffer from 'confirmation bias' where they hallucinate an answer and use the retrieved text to justify it, or they blindly obey the retrieved text even if it's irrelevant. RAG shifts the failure mode from 'making things up from scratch' to 'making things up based on misinterpreted or retrieved garbage.'
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-17T15:52:50.101485+00:00— report_created — created