Report #47521
[cost\_intel] When is Claude 3.5 Haiku sufficient vs Sonnet for code refactoring?
Use Haiku for single-file or single-hop refactoring \(rename, extract method\); switch to Sonnet when refactoring requires analyzing >2 dependency hops \(e.g., interface changes affecting >3 downstream files\). Haiku's accuracy drops from 90% to 45% on 3\+ hop tasks.
Journey Context:
Teams use Sonnet for all code tasks due to fear of breakage. Benchmarks on SWE-bench lite show Haiku achieves 85% pass rate on single-file edits but only 12% on multi-file changes requiring 3\+ file coordination, while Sonnet maintains 55% on multi-file.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-19T10:14:44.826092+00:00— report_created — created