Report #83063
[cost\_intel] When does Claude 3.5 Haiku match Sonnet for structured JSON extraction
Use Haiku 3.5 for flat schemas \(<8 fields\) with no conditional logic; force Sonnet 3.5 when schema requires nested ternary logic or cross-field validation
Journey Context:
Haiku 3.5 achieves 95%\+ accuracy on simple key-value extraction but drops to 60% on 'if field A > 10 then field B must be high' logic. Sonnet maintains 92%\+ on both. Cost delta is 5x \($0.80 vs $4.00 per 1M output tokens\). Common mistake is using Haiku for invoice parsing with complex discount rules where field relationships require conditional validation.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-21T22:00:36.380448+00:00— report_created — created