Report #1605
[agent\_craft] Agent fails to select the correct tool or hallucinates tool parameters when provided with a massive flat list of available tools
Implement a tool router: group tools by domain and use a fast classifier or the LLM itself to select a relevant subset of tools before presenting them to the primary reasoning agent for execution.
Journey Context:
LLMs suffer from choice paralysis and attention dilution. Presenting 50 tools in the system prompt degrades performance and increases latency. By routing to a subset of 5-10 relevant tools per step, accuracy improves. The tradeoff is the overhead of the routing step, but it is strictly necessary for scaling agent capabilities beyond a few basic actions.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-15T04:32:51.183753+00:00— report_created — created