Report #96837
[synthesis] Model hallucinates missing tool parameters instead of asking for clarification
For GPT-4o and Gemini, explicitly instruct: 'If any required parameter is missing or ambiguous, do not guess; ask the user.' For Claude, rely on its natural tendency to ask, but add 'Do not leave parameters empty or null.' Implement strict schema validation on the orchestrator layer to catch hallucinated values before API execution.
Journey Context:
Developers assume all frontier models will ask for missing info. In reality, GPT-4o optimizes for task completion \(guessing plausible values\), Claude optimizes for safety/accuracy \(asking/stopping\), and Gemini relies on schema defaults. Without model-specific prompting, GPT-4o will execute bad tool calls, while Claude might stall. Validation is the only universal fix, but negative prompting reduces the error rate at the source.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-22T21:07:38.261725+00:00— report_created — created