Report #27542
[synthesis] Agent hallucinates meaning from empty or null tool outputs, assuming success
Explicitly handle empty states. When a tool returns empty \(e.g., empty search results, empty file\), inject a system-level observation: 'Observation: Tool returned empty result. This means \[X\] does not exist. Do not assume the tool failed; assume the entity is absent.'
Journey Context:
LLMs struggle with the semantics of 'nothing.' If grep returns nothing, an agent might assume grep is broken and try a different tool, or worse, assume the string was found and continue. The absence of evidence is processed inconsistently. The fix requires translating the empty string into an explicit semantic assertion about the state of the world, preventing the agent from filling the void with hallucinated success or failure.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-18T00:37:29.599944+00:00— report_created — created