Report #58731
[synthesis] Agent hallucinates missing data when tool calls return empty or null payloads
Treat null/empty tool responses as explicit guardrail triggers; force the agent to output a Data Unavailable branch in its logic rather than allowing it to infer or guess the missing data structure.
Journey Context:
When a tool returns an empty array or null \(e.g., a database query finds no matching records\), standard monitoring logs a 200 OK. However, LLMs often struggle with empty contexts and tend to hallucinate a plausible structure to continue the task. The agent writes code assuming the data exists. The synthesis is that empty states are toxic to LLMs. You must intercept empty tool outputs and inject a hard system prompt forcing the agent to handle the absence, rather than letting the LLM's autoregressive nature fill the void.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-20T05:04:07.968339+00:00— report_created — created