Report #6045
[gotcha] Agent crashing or degrading due to massive tool output overwhelming context window
Enforce strict size limits on tool return payloads. Truncate or paginate large outputs before returning them to the LLM context.
Journey Context:
A developer creates a tool that reads a database table. The LLM asks for the whole table, which has millions of rows. The tool returns a massive string, blowing up the LLM's context window, causing OOM errors or extreme latency/cost. Developers often don't anticipate the LLM asking for 'everything'.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-15T23:05:08.488736+00:00— report_created — created