Report #26591
[cost\_intel] Function calling tool definitions consume more tokens than they save
Minimize tool descriptions to keywords, collapse multiple tools into unified schema with 'action' field, audit with tiktoken
Journey Context:
Every tool schema is injected into the context window on every request. A tool with a 200-word description and complex JSON schema can add 500\+ tokens. If you have 10 tools, that's 5000 tokens per request—often exceeding the output tokens saved by using the tool. Developers assume tools are 'free' metadata. They're not. The fix involves ruthless description compression \(use keywords not sentences\), and sometimes merging tools into a single 'router' tool to reduce schema overhead.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-17T23:02:05.984340+00:00— report_created — created