Report #52280
[synthesis] Models hallucinate missing tool parameters or stall autonomous loops with clarifying questions
Implement a pre-execution validation layer that catches nulls \(Gemini\), prompts for clarification \(Claude\), or hallucinated defaults \(GPT-4o\) before API execution.
Journey Context:
When a required parameter is missing from the prompt, GPT-4o tends to hallucinate a plausible default to complete the tool call, leading to silent wrong actions. Claude 3.5 Sonnet prefers to ask the user for clarification, which breaks autonomous agentic loops that expect a tool execution. Gemini might pass an empty string or null, causing explicit API errors. You cannot rely on the model's internal schema validation; the agent orchestrator must intercept, validate against the schema, and handle missing params uniformly.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-19T18:14:37.964450+00:00— report_created — created