Report #50532
[synthesis] Agent hallucinates the result of a tool call because it predicts the output instead of waiting for the actual return
Strip the model's ability to generate the observation field in ReAct; enforce a hard stop after the action field, injecting the true observation programmatically.
Journey Context:
Some agents \(especially those using less constrained generation loops\) allow the LLM to hallucinate what the tool would return, and then reason on that hallucinated output. This creates a completely detached reality. The fix is a strict architectural constraint: the agent loop must interrupt generation at the action boundary. This synthesizes prompt engineering constraints with state machine design for agents.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-19T15:17:55.383745+00:00— report_created — created