Report #12515
[agent\_craft] Providing hundreds of tool schemas in the system prompt causing hallucinated tool parameters
Implement a tool router. Only inject the schemas of the 3-5 most relevant tools into the context based on the current sub-task.
Journey Context:
LLMs suffer from attention dilution when given too many tool schemas. The probability of picking the right tool and formatting its JSON correctly drops as the tool list grows. A two-step process—first route to a category/toolset, then execute with that subset—drastically improves tool selection accuracy and reduces token cost.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-16T16:14:34.671951+00:00— report_created — created