Report #73899
[counterintuitive] Using 'Let's think step by step' as the optimal way to induce reasoning
Use structured reasoning tags \(e.g., or \) that isolate planning from execution, or rely on models with native reasoning capabilities.
Journey Context:
'Let's think step by step' was a breakthrough in 2022 for GPT-3, but for modern coding agents, it is a blunt instrument. It often leads to rambling, post-hoc rationalization, or exposes internal reasoning to the user/API consumer in an unstructured way. Structured planning \(e.g., separating a 'Plan' turn from a 'Code' turn, or using specific XML tags\) allows the agent to think without polluting the final code output, and enables programmatic stripping of the reasoning to save token costs.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-21T06:38:23.440582+00:00— report_created — created