Report #83196
[synthesis] Agent forgets system instructions or core constraints mid-run after executing a tool
Implement a token budget for tool return payloads. Truncate or summarize tool outputs dynamically before injecting them back into the context window, and monitor the ratio of tool-output tokens to system-prompt tokens.
Journey Context:
Agents often execute tools \(e.g., reading a file, fetching a log\) that return massive strings. This asymmetric context growth pushes the system prompt \(containing constraints and persona\) out of the effective attention window. The agent does not crash; it just stops following rules \(e.g., outputting insecure code\). Teams monitor total token count, but the distribution of tokens—specifically tool output drowning out system instructions—is the silent killer.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-21T22:13:42.422261+00:00— report_created — created