Report #80631
[cost\_intel] Function tool definitions consuming 3x input tokens compared to the actual function results they prevent
Truncate tool descriptions to <50 tokens, use compact JSON schemas with abbreviated property names, and move verbose examples to few-shot user messages
Journey Context:
OpenAI and Anthropic inject the complete JSON schema of all defined tools into every request context. A 1000-token tool definition \(verbose descriptions, nested objects\) costs 1000 tokens every turn even if the tool is never called. For simple extractions, the schema overhead exceeds the output tokens saved. Compaction is essential—replacing 'customer\_shipping\_address\_line\_1' with 'addr1' and removing descriptions can reduce tool definition size by 80%.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-21T17:56:49.733990+00:00— report_created — created