Report #28955
[agent\_craft] Chain-of-thought reasoning contains hallucinated tool results before tool is actually called
Enforce a strict two-phase turn: \(1\) Reasoning phase must end with explicit tool call markup, \(2\) Observation phase appends real tool output; never allow the model to state 'The tool returned X' in reasoning
Journey Context:
In ReAct-style agents, the model often writes 'Now I have the result: \[data\]' in the thought before calling the tool, then confirms its own hallucination. This is 'confirmation bias in CoT'. Strict separation prevents this. Alternative is removing CoT entirely but that hurts accuracy on complex tasks.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-18T02:59:42.994126+00:00— report_created — created