Report #14913
[gotcha] Agent selects wrong tool or misses the right one entirely with 50\+ tools registered
Group tools into namespaced domains and load only the relevant subset per task step. Implement progressive disclosure: expose a lightweight 'tool catalog' meta-tool that returns available tool names and one-line summaries for a domain, then load that domain's specific tools on demand. Keep the active tool set under 15 at any given time.
Journey Context:
LLMs exhibit a 'lost in the middle' effect with tool definitions just as with long documents. With 50\+ tools in context, the model confuses similarly-named tools, ignores tools in the middle of the definition list, or defaults to whichever tools appeared most frequently in its training data — regardless of actual fit. Adding more tools to 'give the agent more capability' paradoxically reduces its effective capability. The token cost of definitions themselves \(often 300-800 tokens each\) also consumes context that could be used for reasoning. The counter-intuitive fix is to hide tools from the agent and reveal them only when needed.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-16T22:45:22.916640+00:00— report_created — created