Report #71408
[cost\_intel] Claude 3 Haiku fails on >100 line code edits causing 5x retry cost vs Sonnet single pass
Use Haiku for <50 line diffs only; switch to Sonnet when file length >200 lines or edit complexity involves >3 functions
Journey Context:
Haiku is 10x cheaper \($0.25 vs $3 per 1M tokens\) but fails on complex code context. It generates plausible but wrong multi-file edits, requiring human or Sonnet retry. Signature: high completion acceptance rate drop-off. Cost analysis: 1 Sonnet call = 12 Haiku calls, but if Haiku needs >2 retries, Sonnet is cheaper. Threshold: file length/complexity metrics.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-21T02:26:20.451986+00:00— report_created — created