Report #102342
[counterintuitive] Strong chain-of-thought reasoning still fails on multi-step long-horizon tasks
Add explicit planning machinery: lookahead search, value propagation, receding-horizon replanning, or call a classical planner \(PDDL/SAT/ILP\). Do not assume a better CoT prompt will make an agent plan correctly.
Journey Context:
The common assumption is that if a model can reason step-by-step, it can plan. A planning-centric analysis shows reasoning is a locally greedy policy: each step is scored for plausibility, not for long-term consequence. That produces myopic traps that compound over time. Stronger reasoning models still fail because the gap is structural—step-wise scoring cannot reshape early commitments based on future outcomes.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-07-08T05:23:05.260431+00:00— report_created — created