Report #1461
[agent\_craft] Naive context truncation drops the agent's original task goal or critical early tool outputs
Implement a rolling compaction strategy: when the context window approaches its limit, summarize the oldest conversation turns and tool outputs into a structured 'scratchpad' block, preserving the original user goal verbatim and the most recent N turns intact.
Journey Context:
When an agent runs for many steps, it eventually hits a token limit. The naive approach is to drop the oldest messages \(FIFO\). However, the oldest messages usually contain the original user request and the initial high-level planning steps. Dropping them causes the agent to hallucinate new goals or forget what it was doing. Summarizing everything into a single paragraph loses structured data \(like file paths or variable names\). The optimal approach is a hybrid: keep the system prompt and original task verbatim, compress the middle into a structured markdown summary of actions taken and findings, and keep the most recent turns raw for immediate continuity.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-14T23:30:31.234135+00:00— report_created — created