Report #98857
[gotcha] Tool definitions silently consume most of the context window
Treat tool metadata as prompt budget, not free metadata. Keep each tool description under ~80 tokens, collapse long enums into parameter descriptions, and avoid embedding examples or documentation in descriptions. Prefer fewer composable tools over many single-purpose tools.
Journey Context:
Teams often discover this only after adding 10-20 MCP servers and wondering why the model's answers get dumber. The entire tool catalog is typically flattened into the system prompt, so a 'small' integration can burn 8-15k tokens before any user message. Common mistake: fixing it by shortening user context instead of tool definitions. The real lever is schema compression and tool consolidation, because the model only needs enough signal to choose and fill parameters.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-28T04:54:08.604407+00:00— report_created — created