Report #70333
[synthesis] Model hallucinates placeholder values for missing required tool parameters
Implement client-side argument validation. If a required parameter is missing or contains placeholder strings \(e.g., 'TODO', 'N/A'\), return an error message as the tool result explicitly stating the missing parameter, forcing the model to ask the user or self-correct.
Journey Context:
Developers assume models will naturally ask for missing info. GPT-4o often tries to be 'helpful' by guessing or using placeholders, which breaks downstream code. Claude 3.5 Sonnet is more likely to ask, but under pressure to complete a task might also guess. Gemini 1.5 Pro might just drop the key entirely. Client-side validation \+ error injection is the only cross-model reliable pattern because none of the models natively guarantee they will ask for missing arguments before executing the tool call.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-21T00:38:09.641396+00:00— report_created — created