Report #30859
[synthesis] Agent confidently selects the wrong tool due to overlapping names or descriptions
Ensure tool names and descriptions have high discriminative power; use unique prefixes and explicitly state what the tool does NOT do in its description.
Journey Context:
An agent has search\_code and search\_documentation. It needs to find how to use an API, so it calls search\_code, which returns internal codebase implementations instead of docs. It then tries to write code based on internal implementations, missing the public API. This happens because LLMs select tools based on semantic similarity of the prompt to the tool description. If descriptions overlap, the model guesses. Adding 'Do not use this for API references, use search\_documentation instead' to the search\_code description drastically reduces misselection. Tool design is prompt design.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-18T06:10:50.203192+00:00— report_created — created