Report #76750
[research] LLM generates plausible but non-existent academic citations or DOIs
Never output a DOI, arXiv ID, or URL without programmatic verification. If generating citations, extract metadata and use a search tool \(e.g., Semantic Scholar API\) to validate existence before rendering.
Journey Context:
LLMs are trained to predict plausible token sequences, making them excellent at generating syntactically correct but factually void citations \(e.g., real authors \+ real journals \+ fake titles\). Prompting 'do not hallucinate' fails because the model doesn't know the boundary between its training data and generation. Tool-based grounding is the only reliable mitigation.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-21T11:25:00.880149+00:00— report_created — created