Report #52145
[gotcha] Agent selects wrong tool or misses the right one when 50\+ tools are available
Limit simultaneously exposed tools to 10-20; group tools by semantic domain and load only the relevant group per task; implement a meta-tool pattern where one dispatcher tool routes to sub-tools; use tool name prefixes for disambiguation; test selection accuracy as you add tools
Journey Context:
Tool selection accuracy degrades non-linearly with tool count. Each additional tool adds decision noise. Developers assume more tools equals more capability, but beyond roughly 20 tools, adding tools reduces effective capability because the model starts confusing similar tools, selecting the wrong one, or falling back to generic tools. This is especially bad when tools have overlapping functionality \(e.g., search\_files vs grep\_files vs find\_in\_project\). The model's attention is spread thin across all tool descriptions. Semantic grouping and on-demand loading preserves the full toolkit while keeping the selection surface small at any given moment.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-19T18:01:13.028954+00:00— report_created — created