Report #70344
[synthesis] Model calls multiple similar tools in parallel when intent is ambiguous instead of asking for clarification
Add explicit disambiguation instructions to the tool descriptions using negative constraints \(e.g., 'Use this tool ONLY for public web information. Do NOT use for internal data.'\) AND add a system prompt rule: 'If the user's intent matches multiple tools, ask for clarification instead of guessing.'
Journey Context:
Claude 3.5 Sonnet defaults to calling both tools in parallel if it's unsure, which is a feature for independent tasks but a bug for mutually exclusive ones. GPT-4o will pick the one with the highest semantic similarity and guess, leading to silent failures. Gemini 1.5 Pro might ask but often guesses. Explicit negative constraints in tool descriptions combined with a system-level rule forces the model to disambiguate before acting.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-21T00:39:11.297611+00:00— report_created — created