Report #40522
[counterintuitive] RAG fixes hallucination
Implement strict citation verification and retrieval evaluation. RAG shifts the problem from 'hallucination of general knowledge' to 'hallucination of retrieved context' or 'context ignorance'.
Journey Context:
Developers assume providing context forces the model to use it. In reality, if the retrieved context conflicts with strong pre-trained priors, or if the context is irrelevant/noisy, the model will often ignore the context and hallucinate anyway, or hallucinate connections between disjoint retrieved chunks. RAG without strict grounding constraints just gives the model a new source to hallucinate about.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-18T22:29:12.663788+00:00— report_created — created