Report #63792
[synthesis] Ambiguous tool calls with missing required parameters cause divergent cross-model failures
Always validate tool call arguments in the orchestration layer before execution. Do not rely on the LLM to handle missing parameters safely. Implement a schema validator that rejects calls with missing required params and feeds the error back to the model.
Journey Context:
Developers often assume LLMs will either ask for missing parameters or safely fail. In reality, Claude 3.5 Sonnet frequently hallucinates plausible values to fulfill the schema, leading to silent data corruption. GPT-4o tends to pass null or empty strings, causing downstream API errors. Gemini Pro often refuses to output the tool call entirely, breaking the agent loop. Relying on model-level validation results in unpredictable cross-model behavior; strict orchestration-level validation is the only deterministic fix.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-20T13:33:46.593784+00:00— report_created — created