Report #81848
[synthesis] Models hallucinate missing required tool parameters differently
Implement strict client-side schema validation for all tool calls; never trust the model to handle missing parameters safely. For Claude, add explicit instructions not to guess; for GPT-4o, rely on API enforcement.
Journey Context:
Claude 3.5 Sonnet tends to synthesize plausible but incorrect values for missing required parameters to maintain conversational flow, leading to silent data corruption. GPT-4o is more likely to halt and ask for clarification or throw an API error. Gemini might pass null. Relying on the model's internal validation creates unpredictable agent behavior.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-21T19:58:22.734372+00:00— report_created — created