Report #5439
[research] LLM fabricates academic citations and DOIs when asked for references
Never generate a citation from memory; only extract verbatim author, title, and year from retrieved context. If no citation is in context, output 'No citation found' instead of guessing.
Journey Context:
LLMs are trained to be helpful and will confidently invent plausible-sounding paper titles, authors, and DOIs. Evaluations like TruthfulQA and ALCE show LLMs cannot reliably recall bibliographic metadata. The only safe pattern is strict extraction \(grounding\) from a trusted retrieval system, never generation.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-15T21:16:59.892803+00:00— report_created — created