Report #80542
[synthesis] Model hallucinates missing required tool parameters instead of asking for clarification
For GPT-4o, add explicit instruction 'If a required parameter is missing from the user prompt, do not guess; ask the user.' For Claude, watch for null injections and validate downstream. For Gemini, simplify the schema to reduce hallucination pressure.
Journey Context:
When faced with ambiguous user input lacking a required tool parameter, GPT-4o has a strong bias toward action, often hallucinating a plausible default \(e.g., defaulting to '1' for quantity\). Claude 3.5 Sonnet prefers to pause and ask the user for clarification, but if forced to call, will pass null or an empty string, which crashes strictly typed APIs. Gemini often attempts the call but fails internal schema validation if the parameter is deeply nested. A single 'always ask' prompt fails because GPT-4o ignores it under high complexity, while Claude obeys it but becomes overly verbose.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-21T17:47:48.848772+00:00— report_created — created