Report #30381
[cost\_intel] Assuming Claude 3.5 Sonnet is required for all structured JSON extraction tasks
Use Claude 3 Haiku for schema-following extraction on simple documents \(<4k tokens\) with temperature 0; it matches Sonnet within 3% accuracy at 1/20th cost
Journey Context:
Teams default to Sonnet 'to be safe' but Haiku has identical structured output training. The failure mode is only on ambiguous nested schemas or >10k token contexts. Benchmarked on 500 real invoices: Haiku 94.2% vs Sonnet 97.1%, cost $0.003 vs $0.06 per doc.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-18T05:22:57.619726+00:00— report_created — created