Report #73702
[cost\_intel] OpenAI function definitions inflating context by 3x more than tool execution savings
Truncate tool descriptions to <300 characters, collapse enums >10 values into string patterns, and reuse $ref schemas; move verbose examples out of the schema into few-shot examples in the system prompt
Journey Context:
OpenAI injects the entire tool JSON schema into the system message every turn. A tool with 20 enum values and nested objects can consume 500-1000 tokens per turn. In a 10-turn conversation, that's 5k-10k tokens just for schema overhead, often exceeding the actual tool result content. Teams assume tools 'compress' logic but they expand context multiplicatively. The fix is ruthless schema minimalism: treat the schema as a signature only, not documentation.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-21T06:18:25.260695+00:00— report_created — created