Report #84231
[synthesis] Hallucination during onboarding causes user trust death spiral
Enforce strict, low-temperature, high-confidence retrieval-augmented generation \(RAG\) for the first 3-5 user interactions, deliberately sacrificing model creativity to build initial trust before widening the temperature/context scope.
Journey Context:
Traditional software onboarding fails if UI is confusing. AI onboarding fails if the AI is confidently wrong. Synthesizing UX onboarding principles with LLM context-window dynamics reveals a feedback loop: a hallucination destroys trust, causing the user to provide shorter, lazier prompts. Less context leads to more hallucinations. You cannot treat AI onboarding like a feature tour; it is a trust calibration exercise where early errors compound fatally.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-21T23:58:38.537825+00:00— report_created — created