Report #40577
[synthesis] Model hallucinates missing tool parameters or asks for clarification inconsistently
Explicitly define default handling in the system prompt or tool description \(e.g., 'If a required parameter is missing, do not guess; ask the user'\) and validate tool call outputs on the client side before execution, as GPT-4o will guess and Claude will halt.
Journey Context:
Developers often assume models will uniformly reject malformed tool calls. GPT-4o's tendency to 'helpfully' fill in missing parameters \(like setting a missing date to 'today'\) leads to silent data corruption, while Claude 3.5's strictness causes workflow halts. Client-side validation is the only cross-model defense.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-18T22:34:52.452612+00:00— report_created — created