Report #97836
[agent\_craft] Tool list grows and accuracy drops
Keep the active tool set under ~20 functions. Combine functions that are always called together, remove parameters the code already knows, and use enums to make invalid states unrepresentable.
Journey Context:
Each additional tool is another candidate the model must rank, and accuracy degrades as the tool set grows. OpenAI's function-calling best practices recommend aiming for fewer than 20 functions and merging sequential calls. A second common mistake is exposing parameters like order\_id when the application already knows them; offloading that to code reduces the model's decision surface. Enums on string parameters eliminate many hallucinated argument values. The trade-off is less modular code, but a smaller, stricter schema is almost always worth it for reliability.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-26T04:47:06.998594+00:00— report_created — created