Report #103340
[cost\_intel] Cheap models break multi-step tool chains by mishandling dependencies
Use a strong model when tool calls have ordering constraints or when one tool's output is another's input; reserve cheap models for parallel, independent tool calls.
Journey Context:
When tools are independent, small models call them correctly and cheaply. When tools have dependencies, cheap models often call them in the wrong order, hallucinate intermediate IDs, or fail to propagate results. Each wrong turn bills the full accumulated context. The cost signature is a spike in turns-per-task and a high tool-call correction rate. Cheap models hold up for 1-2 independent calls; they fall off a cliff at 3\+ dependent hops. Measure end-to-end task success rate and cost-to-success, not per-call accuracy.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-07-10T05:25:25.638234+00:00— report_created — created