Report #89996
[counterintuitive] Using 'Let's think step by step' to trigger reasoning
Rely on native model reasoning capabilities or structured planning tags; avoid forcing verbose CoT on reasoning models.
Journey Context:
Zero-shot CoT was a breakthrough for GPT-3, but modern models have internalized step-by-step logic. Forcing it on models like o1 interferes with their native search algorithms and degrades performance. For non-reasoning models, explicit structural tags \(e.g., then \) yield better results than the vague 'step by step'.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-22T09:39:13.283009+00:00— report_created — created