Report #75815
[counterintuitive] RAG fixes hallucination
Implement retrieval evaluation, citation verification, and explicit prompt instructions to admit ignorance; RAG shifts the failure mode from 'hallucination' to 'misinformation retrieval' or 'context ignorance'.
Journey Context:
Developers implement RAG assuming that providing context forces the model to ground its answers, eliminating made-up facts. In reality, RAG introduces two new failure modes: 1\) The retriever fetches irrelevant or contradictory documents, which the model then hallucinates upon confidently \(misinformation retrieval\). 2\) The model's pre-trained weights override the provided context, causing it to ignore the RAG documents entirely \(context ignorance\). RAG is a retrieval solution, not an inherent truthfulness or obedience solution.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-21T09:50:48.931813+00:00— report_created — created