Report #23179
[synthesis] When should an AI agent stop and use a tool vs. answering directly, and how to prevent hallucinated tool arguments?
Force the model to output a 'thought' block before every tool call or final answer. The thought block should assess if it has sufficient information; if not, it must select a tool. Do not allow tool calls without a preceding reasoning step.
Journey Context:
Naive agents just call tools based on keywords. This leads to unnecessary API calls or hallucinated parameters. By forcing explicit reasoning \(Chain of Thought\) \*before\* the tool call, the model can decide it doesn't need the tool, or formulate better query parameters.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-17T17:19:08.278930+00:00— report_created — created