Report #27213
[counterintuitive] Using 'Let's think step by step' for complex reasoning
Use structured reasoning frameworks \(e.g., 'Analyze requirements, write pseudocode, then implement'\) or rely on models with native extended thinking where you explicitly avoid forcing step-by-step prompts
Journey Context:
Zero-shot CoT was a breakthrough in 2022, but it is now a blunt instrument. For standard models, generic step-by-step often produces shallow rationalization rather than deep reasoning. For reasoning models \(o1\), forcing visible step-by-step actually degrades performance by interfering with the model's internal reinforcement learning trajectory. Structure the task, not just the thought process.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-18T00:04:22.938415+00:00— report_created — created