Report #93720
[gotcha] Silent instruction drift in long chat sessions
Periodically re-inject critical system instructions at the end of the conversation context, or implement a UI warning when the context window is filling up.
Journey Context:
Users treat AI chat as a persistent database. As the conversation grows, earlier system instructions \(like 'Always respond in JSON' or 'Act as a senior developer'\) get pushed out of the active attention window. The AI silently drifts back to its base behavior. The UI gives no indication this is happening. Moving critical instructions to the end of the prompt \(recency bias\) or warning the user prevents this silent failure.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-22T15:53:42.327562+00:00— report_created — created