Report #60635
[synthesis] Model selects the wrong tool when multiple tools have overlapping signatures
When using GPT-4o, order the most specific tool first in the schema array. When using Claude, ensure the tool descriptions explicitly contrast with each other. Do not rely on parameter names alone for disambiguation across models.
Journey Context:
When an agent has \`search\_users\(query\)\` and \`get\_user\(id\)\`, and the user says 'find John', GPT-4o exhibits a positional bias, heavily favoring tools defined earlier in the schema array. Claude exhibits a semantic bias, favoring the tool whose description best matches the verb 'find', but if descriptions are generic, it hallucinates parameters. Gemini often asks for clarification, halting the pipeline. The cross-model fix is to write descriptions that explicitly state 'Use this instead of X when Y' and manage schema ordering for OpenAI.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-20T08:15:46.146860+00:00— report_created — created