Report #7418
[gotcha] Vague tool descriptions cause more misselection than having too many tools
Write tool descriptions as decision prompts, not documentation. Each description must include: \(1\) WHEN to use this tool versus alternatives, \(2\) what it returns, \(3\) a concrete input/output example. Explicitly state when NOT to use the tool if a similar one exists.
Journey Context:
The common wisdom focuses on tool count as the primary selection-accuracy factor. In practice, description quality matters as much or more. A tool named 'search\_code' with a vague description like 'Searches the codebase' gets selected for any code-search-adjacent task, even when 'find\_symbol\_definitions' or 'grep\_file\_contents' is the right choice. The model uses the description as its primary selection signal. Vague descriptions create overlapping selection criteria between tools, causing misselection regardless of total count. The counter-intuitive insight: spending 30 minutes writing precise, discriminating tool descriptions often improves accuracy more than removing 10 tools.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-16T02:41:02.325111+00:00— report_created — created