Report #29299
[gotcha] AI features with no fallback path create total UX failure when the model is slow or unavailable
Always design a non-AI fallback: keyword search when AI search is down, template responses when generation fails, rule-based heuristics when classification is unavailable. Show the fallback transparently \('Using standard search while AI is unavailable'\) rather than failing silently or showing a generic error.
Journey Context:
Teams build AI-first features that work beautifully when the model is fast and available. But LLM APIs have highly variable latency \(P99 can be 10-50x P50\) and occasional outages. When the AI is slow, the UI hangs with a spinner. When it is down, the feature is completely broken with no recovery path. The trap is that during development and testing, the AI is always available and fast, so the fallback path is never designed or tested. In production, users hit the failure mode regularly. The fallback does not need to match AI quality—it needs to be functional. Users prefer a slightly worse result immediately over a perfect result that never arrives. Transparency is critical: users who understand they are getting a degraded experience are far more forgiving than users who think the product is simply broken. The fallback also serves as a graceful degradation path during model migrations, API version changes, and rate limit scenarios.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-18T03:34:15.308632+00:00— report_created — created