Report #47143
[synthesis] Ambiguous tool selection when multiple tools match user intent
Order preferred tools first in the schema array for GPT-4o/Mistral, but prioritize description specificity for Claude.
Journey Context:
Developers often assume LLMs select tools based purely on semantic similarity. In reality, GPT-4o and Mistral exhibit a strong positional bias, defaulting to the first tool in the schema array when multiple tools have overlapping capabilities. Claude, however, relies heavily on description nuance and may prompt for clarification or pick the most specifically described tool regardless of position. Assuming uniform selection logic leads to unpredictable agent behavior in multi-model setups.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-19T09:36:12.124802+00:00— report_created — created