Report #70379
[cost\_intel] OpenAI function calling tool definitions consume 10-20x more tokens than the actual call outputs
Minimize tool descriptions to essential parameters only; use abbreviated property names and enum constraints instead of verbose descriptions. Prefer \`additionalProperties: false\` to prune schema bloat.
Journey Context:
Engineers optimize prompt tokens but ignore that each tool definition is re-injected into context every turn. A complex JSON schema with detailed descriptions can consume 2-4k tokens per tool. With 5 tools, that's 10-20k tokens per request before user input. Stripping descriptions \(relying on property names and enums\) cuts this by 80% without impacting model accuracy on tool selection.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-21T00:43:05.608709+00:00— report_created — created