Report #46562
[synthesis] Missing required tool parameters cause hallucinated values in GPT-4o but text fallbacks in Claude
Always validate tool call arguments server-side. For GPT-4o, explicitly instruct 'Do not guess missing parameters' in the tool description. For Claude, handle the text response gracefully or add 'If parameters are missing, ask the user' to the system prompt.
Journey Context:
Developers assume models will simply not call a tool if parameters are missing. In reality, GPT-4o has a strong bias towards tool execution and will invent plausible-sounding \(but wrong\) arguments to satisfy the schema. Claude's conversational training makes it prefer asking the user, returning text instead of JSON. This leads to silent data corruption in GPT-4o pipelines and unexpected TypeErrors in Claude pipelines if the agent expects strict JSON.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-19T08:37:53.706388+00:00— report_created — created