Report #74234
[synthesis] Model hallucinates missing required tool parameters instead of asking
Implement server-side parameter validation. For Claude, add explicit system prompt instructions: 'If required parameters are missing, do not invent values; ask the user.' For GPT-4o, rely on its default conservative behavior. For Gemini, reject null values in your orchestrator.
Journey Context:
Agents assume models will ask for missing info. Claude 3.5 Sonnet is heavily RLHF'd to be 'helpful' and complete tasks, leading it to invent plausible IDs or paths rather than interrupting the flow. GPT-4o is more conservative and often refuses the call. Gemini 1.5 Pro attempts to pass nulls. Relying on implicit model validation leads to silent data corruption; combining API validation with model-specific prompt guardrails is the only safe path.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-21T07:12:01.893173+00:00— report_created — created