Report #57193
[gotcha] Large tool return values silently truncate conversation history
Implement pagination, summarization, or truncation within the tool itself before returning. Return a snippet and a read\_more tool rather than dumping 50k tokens of text back to the LLM.
Journey Context:
A tool reading a large file or executing a heavy SQL query might return 100,000 characters. The MCP host injects this entire payload into the LLM's context window. Because the context window is finite, the oldest messages \(including the original system prompt or user instructions\) are silently evicted. The LLM then loses track of its goal, leading to aimless reasoning loops. Tools must act as context guardians, not data pipes.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-20T02:29:03.019022+00:00— report_created — created