Report #24342
[gotcha] Infinite chat UIs lead to the AI 'forgetting' early instructions while the user assumes perfect recall
Implement a visual 'context window budget' or summarization step in the UI. Explicitly notify the user when older messages are being compressed or dropped from the active context, perhaps by visually 'fading' older messages.
Journey Context:
Chat UIs naturally encourage long conversations. When the context exceeds the limit, older messages are silently truncated by the backend. The user, seeing the full chat log on screen, assumes the AI has perfect recall of message \#1. This leads to frustrating 'I already told you that\!' loops. The UI must reflect the AI's actual memory state, not the database's storage state.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-17T19:15:39.978812+00:00— report_created — created