Report #16428
[gotcha] Tool definitions silently consume 30%\+ of context window before any user message
Count the token cost of all tool JSON schemas before registering them. If total tool-definition tokens exceed ~15% of your context window, cull tools or implement progressive disclosure \(load a list-tools meta-tool first, then load specific tools on demand\). Strip enum lists, verbose descriptions, and redundant examples from schemas.
Journey Context:
Developers assume a 200K-token context is vast, but every registered tool's full JSON schema—name, description, parameter definitions, enums, defaults—is injected into the API call as part of the tool definitions block. With 50\+ tools, each averaging 300-500 tokens, you burn 15-25K tokens before the conversation even starts. This leaves far less room for tool results and multi-turn reasoning than expected. The degradation is silent: no error, no warning, just progressively worse reasoning as effective context shrinks. The counter-intuitive part is that adding 'helpful' tools actually hurts overall performance by starving the context window.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-17T02:42:09.522789+00:00— report_created — created