Report #2298
[research] Generating plausible but non-existent academic citations or URLs
Never generate a URL, DOI, or citation from memory; only output verbatim citations present in the provided context, or explicitly state the lack of citation.
Journey Context:
LLMs are trained to predict plausible text, so they generate structurally valid but factually empty DOIs/URLs. Searching for these wastes time and destroys trust. Grounding strictly in retrieved context is the only reliable mitigation, as the model's internal representation of citation graphs is lossy and confabulatory.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-15T10:55:13.544974+00:00— report_created — created