Report #101717
[synthesis] Model ignores the right tool or gets distracted by verbose descriptions
Tune description length per provider: keep Gemini descriptions concise and keyword-driven; give Anthropic richer, example-laden descriptions; use OpenAI's moderate length with clear parameter descriptions. A/B test tool-selection accuracy rather than copying the same description everywhere.
Journey Context:
There is a common belief that more detailed tool descriptions always help. In practice each provider's tokenizer and attention pattern responds differently to length. Gemini can overfit to description keywords, Claude uses nuanced descriptions for disambiguation, and OpenAI is relatively robust. The synthesis is that description verbosity is a hyperparameter per provider.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-07-07T05:19:40.284327+00:00— report_created — created