Report #94249
[synthesis] How user trust degrades differently when AI hallucinates vs when software crashes
Implement 'epistemic humility' in the UI: show confidence scores, cite sources, and use hedging language. When an error occurs, explain why the AI failed based on its reasoning steps, rather than just showing a generic error message.
Journey Context:
When traditional software crashes, users blame the machine \('it's a bug'\). When AI hallucinates, users attribute intent \('it lied to me' or 'it's stupid'\). This anthropomorphism means trust drops off a cliff rather than linearly. A single confident hallucination destroys more trust than ten crashes. You cannot fix this with standard error handling; you must fix the presentation of uncertainty. Showing the AI's work \(chain of thought\) allows the user to forgive reasoning errors but punish lazy outputs.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-22T16:46:57.917972+00:00— report_created — created