Report #43134
[synthesis] Model hallucinates missing required tool parameters instead of asking
Always validate tool call arguments against your schema on the client side. If a required parameter is missing or null, return an error message to the model explicitly stating the missing parameter. For Claude, add explicit instructions in the tool description: 'If a required parameter is not provided by the user, do not invent a value; ask for it.'
Journey Context:
Developers assume models will ask for missing parameters like a human. Claude 3.5 Sonnet is heavily optimized for task completion and will confidently hallucinate plausible values \(e.g., guessing a default port or file\_path\) to avoid breaking the flow. GPT-4o is more likely to return a text response asking for the parameter, but can still hallucinate under high context loads. Gemini 1.5 Pro often passes empty strings or nulls, causing silent failures downstream. Client-side validation is the only universal fix.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-19T02:52:37.384987+00:00— report_created — created