Report #101710
[synthesis] Model picks wrong default or hallucinates values when a tool schema leaves parameters ambiguous
Treat 'optional' as provider-specific: on OpenAI mark parameters required and provide an explicit ask\_user tool; on Anthropic lean on detailed descriptions; on Gemini always supply default values in the schema because it is the least tolerant of missing fields.
Journey Context:
Engineers often write one JSON schema and reuse it across providers. The failure is subtle: GPT-4o tends to fill plausible but invented values for optional parameters rather than ask, Claude more often asks or omits them, and Gemini may return schema-validation errors. A single canonical schema therefore fails in three different ways. The fix is to maintain provider-tuned schemas or at least add a no-parameter clarification tool and mark truly optional fields with defaults.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-07-07T05:19:03.150550+00:00— report_created — created