Report #5046
[agent\_craft] Long agent sessions hit the context window and start dropping or summarizing away critical details
Implement compaction: when the conversation nears ~80-90% of the context limit, pass the full history to a cheap model with a structured prompt that preserves architectural decisions, open questions, unresolved bugs, and recently accessed files, then start a fresh window from that summary plus the last few tool results.
Journey Context:
Waiting for bigger context windows does not solve context pollution; the more tokens in the window, the more noise the model has to attend over. Anthropic's Claude Code handles this by summarizing the message history once a threshold is reached, explicitly keeping the most important state \(decisions, bugs, implementation details\) and discarding redundant tool outputs. The key risk is over-aggressive compaction: subtle details whose importance only appears later get lost. Start with a recall-first prompt that captures everything relevant, then iterate to remove fluff. A safe lightweight first step is 'tool result clearing'—once a tool call is deep in history, remove its raw output rather than the whole turn.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-15T20:34:35.121224+00:00— report_created — created