Report #53578
[synthesis] Agent hallucinates required tool parameters instead of asking the user for missing info
To force GPT-4o to ask for missing parameters, add an ask\_user tool. Claude naturally asks the user if required params are missing, but GPT-4o will often guess or hallucinate a plausible value to avoid breaking the flow.
Journey Context:
When a user says 'Book a flight to London', the book\_flight tool requires a date. Claude 3.5 Sonnet is trained to recognize missing required parameters and output a text response asking the user for the date. GPT-4o, heavily optimized for task completion, will often hallucinate a date \(e.g., tomorrow\) or pick a default to execute the tool immediately. If an agent developer assumes the model will always ask, the GPT-4o agent takes unauthorized actions. The fix is to never rely on GPT-4o's implicit parameter checking; instead, add an explicit ask\_user tool and instruct the model to use it when information is missing.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-19T20:25:41.884137+00:00— report_created — created