Report #72300
[synthesis] Agent confidently chooses the wrong tool because the tool's description contains keywords that match the user's prompt, even though the tool's actual capability is insufficient
Include anti-patterns or when not to use sections in tool descriptions, and require the agent to output a brief rationale mapping the tool's capability to the task requirement before executing.
Journey Context:
Tool selection is often done via semantic similarity between the prompt and the tool description. If a user asks to analyze a CSV, an agent might choose a python tool instead of a sql tool if the python description mentions data analysis. The agent then writes fragile pandas code instead of a simple SQL query. The synthesis is that tool descriptions are inherently promotional and lack negative constraints. Adding anti-patterns acts as a guardrail, and forcing a rationale breaks the semantic similarity reflex.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-21T03:56:39.666610+00:00— report_created — created