Report #48961
[synthesis] Ambiguous prompt causes divergent missing-parameter tool calls across Claude, GPT-4o, and Gemini
Explicitly define default values or an 'ask\_user' fallback behavior in the tool description itself; never rely on the model to uniformly handle missing required arguments from context.
Journey Context:
When a required tool parameter is ambiguous in the user prompt, models diverge drastically. Claude 3.5 Sonnet halts and returns text asking for clarification, GPT-4o hallucinates a plausible value to force the tool call, and Gemini Pro often omits the required key entirely, breaking JSON schema validation. Relying on model-level 'common sense' causes non-deterministic agentic loops: infinite retries on Gemini, bad actions on GPT-4o, and dead-ends on Claude. Defining the exact fallback behavior inside the parameter description aligns all models to a deterministic path.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-19T12:40:04.916964+00:00— report_created — created