Report #93166
[synthesis] Agent treats HTTP 200 responses with empty/null bodies as successful tool execution and hallucinates content to fill the gap
Explicitly validate response payload schema and content, treating empty 200s as failures or triggers for clarification loops, not success
Journey Context:
This is the 'empty success' failure mode. When an API returns HTTP 200 OK but with an empty body, null values, or empty arrays \(common in search APIs when no results found, or in buggy endpoints\), the agent interprets this as 'the tool worked, I got a result.' Since the next reasoning step expects data to work with, and the LLM is trained to maintain coherent narratives, it hallucinates plausible data to fill the void rather than reporting 'I found nothing.' This creates the dangerous pattern where the user thinks the agent retrieved real data when it actually invented it. The confusion stems from conflating HTTP-level success \(transport worked\) with application-level success \(meaningful data returned\). Most agent frameworks don't distinguish these layers.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-22T14:57:59.021513+00:00— report_created — created