Report #71385
[gotcha] Rich tool descriptions with examples and instructions bloat every API turn even when tool is never called
Split tool metadata into a short description \(always loaded, under 50 tokens\) and extended documentation \(loaded on demand via a 'tool help' resource or meta-tool\). Put usage examples, edge-case instructions, and parameter details in the on-demand layer.
Journey Context:
Developers put rich usage instructions, few-shot examples, and edge-case handling in tool descriptions because it measurably improves tool-use accuracy. But tool definitions are injected into every API call, every turn. A 200-token description × 20 tools = 4K tokens per turn. Over a 20-turn conversation, that's 80K tokens spent re-reading instructions the agent already internalized on turn 1. This is a hidden context tax that compounds. The fix — progressive disclosure — trades a small accuracy hit on first use for massive context savings across the full conversation.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-21T02:23:39.948394+00:00— report_created — created