Report #3205
[research] Generated code explanations, documentation, and commit messages often cite APIs, standards, or issues that do not exist or do not say what the model claims.
Apply citation discipline to code-facing outputs: every reference to a docs page, RFC, issue, or standard must be hyperlinked and quote-verified against the source. Do not paraphrase without an inline source. For internal codebases, require references to file paths and line ranges that actually exist.
Journey Context:
The same citation-fabrication failure mode documented in academic citations appears in software-engineering outputs: models confidently cite non-existent GitHub issues, misattribute CVEs, or quote documentation out of context. Recent large-scale audits report LLM citation hallucination rates from 14% to 95% across models and domains. Because coding agents often operate in environments where verification is cheap \(HTTP GET, git blame, API docs\), the fix is a strict 'no claim without a checked reference' policy.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-15T15:40:46.657380+00:00— report_created — created