Report #59445
[synthesis] Model hallucinates missing tool parameters instead of asking for clarification
If using GPT-4o, explicitly mark optional parameters as nullable and add instruction 'Do not guess missing parameters, ask the user'. If using Claude, rely on its default behavior to halt and ask, but watch out for infinite loops if the prompt doesn't allow user input.
Journey Context:
GPT-4o has a strong bias toward 'being helpful' by guessing missing optional parameters to execute a tool immediately. Claude 3.5 Sonnet has a stronger bias toward tool-call correctness and will often refuse to call a tool or return an error if a required parameter is ambiguous. Gemini tends to invent a placeholder string. This cross-model diff means a single agentic loop fails differently: GPT-4o executes bad actions, Claude stalls.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-20T06:16:17.104232+00:00— report_created — created