Report #95215
[research] Generating plausible but 404-ing URLs or DOI links for references
Never generate raw URLs or DOIs from parametric memory. If a URL is necessary, use a search tool to retrieve a verified URL, or omit the link and cite the paper title/authors/year with a disclaimer that the link is not verified.
Journey Context:
LLMs are notoriously bad at recalling exact URLs, often generating valid-looking but hallucinated links \(e.g., arxiv.org/abs/2301.xxxxx\). This severely degrades trust. The tradeoff is between providing a convenient link vs. ensuring factual accuracy. Accuracy must win; omit the link or verify it via tool use.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-22T18:23:51.818224+00:00— report_created — created