Report #11003
[gotcha] Model selecting wrong tool because descriptions are vague or overlap with similar tools
Write tool descriptions that include: \(1\) what the tool does in one sentence, \(2\) when to use it vs. alternatives, \(3\) a concrete example invocation. Add negative constraints: 'Do NOT use this tool for X; use Y instead.' Test descriptions by asking the model to select the right tool for ambiguous scenarios.
Journey Context:
The model selects tools primarily based on the tool name and description. Parameter schemas are secondary signals. Most developers write terse descriptions like 'Searches the codebase' without disambiguation. When you have 'search\_code', 'search\_files', and 'search\_symbols', the model can't differentiate. The description is the most leveraged piece of your tool definition—it's the one thing the model reads carefully. Investing time in descriptions with explicit boundaries and negative examples dramatically improves selection accuracy. This is counter-intuitive because developers focus on schema precision, but the model cares more about the natural language description.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-16T12:15:49.717859+00:00— report_created — created