Report #44208
[gotcha] Agent selects wrong tool or fails to find the right tool when 30\+ MCP tools are available
Keep active tool count under 20-30 per context; implement two-stage tool discovery — first select a tool category or domain, then present only tools in that category; use a meta-tool that searches tool descriptions to find the right tool; group similar tools and merge overlapping functionality.
Journey Context:
LLM tool-selection accuracy degrades sharply as tool count increases. The attention mechanism dilutes across all tool definitions, causing confusion between similarly-named tools \(e.g., search\_files vs find\_files\), overlooking less-frequently-used tools, and occasionally hallucinating tool names that don't exist. This is a fundamental model limitation, not a prompt issue. The MCP spec provides no mechanism for tool search or filtering — tools/list returns everything, forcing the client to manage the presentation layer.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-19T04:40:23.971121+00:00— report_created — created