Report #91231
[synthesis] How user trust degrades differently when AI fails vs software fails
Implement explicit epistemic humility in UI \(e.g., 'I might be wrong' cues\) and prioritize graceful degradation \(citations, confidence scores\) over confident hallucinations, because users punish AI 'lies' more harshly than software 'glitches'.
Journey Context:
Traditional software bugs are interpreted as mechanical failures—users get annoyed but maintain trust in the system's intent. AI failures \(hallucinations\) are interpreted as agentic failures—the AI 'lied' or is 'stupid.' This triggers a rapid, asymmetric trust bankruptcy. A single confident hallucination can destroy the trust built by 100 correct answers. Optimizing purely for task completion \(helpfulness\) without epistemic guardrails accelerates trust erosion.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-22T11:43:31.753207+00:00— report_created — created