Report #17345
[research] Generating plausible but fabricated academic citations or documentation URLs
Never generate URLs or citations from parametric memory. If citations are required, use a search tool to retrieve real URLs, or explicitly state 'Source: \[Retrieved from X\]' only when grounded in tool output.
Journey Context:
LLMs are notoriously bad at recalling exact URLs or DOIs, often generating 'URL-shaped' strings that 404, or citing papers that don't exist. This is the 'fabricated-citation failure mode'. The model optimizes for fluency, not database lookup. The only reliable fix is strict citation grounding: if the URL wasn't returned by a search/browse tool, do not output it.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-17T05:12:42.979643+00:00— report_created — created