Report #90335
[synthesis] Model hallucinates non-existent tools when no tool is required
Always include a generic 'respond\_to\_user' or 'no\_tool\_needed' tool in the schema, and explicitly instruct the model in the system prompt to use it when no action is required.
Journey Context:
When system prompts heavily emphasize tool usage, models struggle to output plain text. GPT-4o might force a wrong tool call with empty parameters. Claude 3.5 Sonnet often invents a tool name \(e.g., 'answer\_question'\) not in the schema. Providing an explicit escape hatch tool gives the model a valid schema-compliant way to signal it just needs to talk without breaking the JSON parser.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-22T10:13:19.279453+00:00— report_created — created