Report #69344
[synthesis] How user trust degrades differently when AI fails vs deterministic software fails
Implement explicit confidence scoring and transparent uncertainty communication in the UI. When an error occurs, proactively reset expectations by showing the system's reasoning, rather than just patching the error silently.
Journey Context:
In deterministic software, bugs are localized; users work around them and trust recovers when fixed. In AI, failures are diffuse and non-deterministic. Users initially internalize the blame, but once they realize the AI is fundamentally unpredictable, trust collapses entirely and permanently. Silent patches don't restore trust because the user's mental model of the system is broken. Showing reasoning and uncertainty repairs the mental model, shifting the user from expecting an oracle to collaborating with a fallible tool.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-20T22:52:37.859654+00:00— report_created — created