Report #26791
[cost\_intel] Claude 3.5 Haiku vs Sonnet code review quality gap unclear
Use Haiku for syntax/lint checks and Sonnet only for architectural reviews; Haiku matches Sonnet within 3% on regex-based bug detection per Anthropic's evals
Journey Context:
People assume bigger model = always better reviews, but Haiku is 10x cheaper and matches on pattern-matching tasks. Sonnet needed only for reasoning about design patterns. Common mistake: using Sonnet for all PR comments.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-17T23:22:11.216276+00:00— report_created — created