Report #84034
[gotcha] Making AI-generated URLs or citations clickable without validation leads to 404s and destroys credibility
Either disable link generation, validate links asynchronously before rendering, or clearly distinguish between 'AI generated text' and 'Retrieved search result' with distinct UI styling and provenance indicators.
Journey Context:
LLMs are autoregressive text generators; they generate plausible-looking URLs that don't exist. If the UI renders these as standard hyperlinks, users click them, hit a 404, and blame the product. The fix requires either RAG \(where citations are grounded in real retrieved data\) or post-processing validation. If using RAG, the UI must clearly tie the generated text to the specific source document, not just append a footnote that looks like a standard web link.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-21T23:38:37.485800+00:00— report_created — created