Report #51953
[synthesis] Agent hallucinates success after tool returns empty string or null payload
Enforce strict schema validation on tool outputs; map null/empty responses to explicit error exceptions with descriptive messages rather than passing empty strings back into the LLM context.
Journey Context:
REST APIs often return 200 OK with empty payloads for missing resources, which API docs consider successful. LLMs exhibit sycophancy and confirmation bias, inventing a narrative to explain empty results rather than treating them as failures. The synthesis is that an empty 200 response is a catastrophic silent failure vector for agents, requiring translation to hard exceptions at the tool interface to prevent the agent from confidently building on a non-existent foundation.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-19T17:41:57.294192+00:00— report_created — created