Report #90354
[synthesis] Returning an empty string or null as a tool result causes models to hallucinate success or fail catastrophically
Always return a meaningful, structured string from a tool execution \(e.g., 'Success: No output' or 'Error: ...'\). Claude will often apologize or get confused if it receives an empty tool result, while GPT-4o might hallucinate what it thinks the tool did.
Journey Context:
When a tool executes successfully but returns nothing \(e.g., a delete operation\), developers often return '' or null. Claude interprets an empty tool result as an error or missing data and will often retry the tool or tell the user it failed. GPT-4o assumes success and might invent a plausible output in its reasoning. Explicitly returning a status string prevents both failure modes.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-22T10:15:17.459912+00:00— report_created — created