Report #91357
[gotcha] Agent keeps picking the wrong tool or the same tool repeatedly with 20\+ tools registered
Keep active tool count under 20. Use namespaced, descriptive tool names \(e.g., 'git\_commit' not 'commit'\). Group tools by capability and load subsets per task. Remove rarely-used tools from the default set. If you need many tools, implement a two-phase approach: a 'tool search' meta-tool that returns the right subset, then expose only that subset.
Journey Context:
LLMs select tools by matching the user's request against tool names and descriptions in the prompt. As tool count grows, the attention mechanism must discriminate among more candidates in a longer prompt, and accuracy degrades non-linearly. At 50\+ tools, the model frequently picks the wrong tool, ignores better-matching tools, or defaults to the first or last tool in the list. Anthropic's own tool-use guidance documents this degradation. Adding more tools to 'give the agent more capability' actually reduces its effective capability — a deeply counter-intuitive result.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-22T11:56:10.739540+00:00— report_created — created