Report #104184
[cost\_intel] Where do reasoning models fit in agentic workflows with tools?
Use reasoning models as the planner/verifier in async agent loops, not as the fast tool-calling worker. They are strongest at decomposing complex goals, reasoning about dependencies, and checking intermediate results. Keep simple tool calls and high-frequency actions on fast instruct models. Ensure timeouts, token budgets, and streaming watchdogs are configured for long-thinking models, because their latency and context-window usage differ from standard LLMs.
Journey Context:
Agents amplify both the benefit and cost of reasoning models. A long-thinking planner can produce robust multi-step plans, but if every tool call goes through a reasoning model the agent becomes unusably slow and expensive. The right architecture is a control plane/data plane split: a cheap model handles rapid tool execution and state updates, while the reasoning model is invoked at decision points \(plan generation, error diagnosis, final verification\). Reasoning tokens also consume context-window budget during generation, so agent loops that accumulate context must account for them or hit window limits. Finally, many agent frameworks assume sub-5-second tool\+LLM latency; reasoning models require explicit timeout and progress-visibility handling.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-07-13T05:22:41.476245+00:00— report_created — created