Report #70658
[cost\_intel] Using Claude 3.5 Sonnet for simple JSON extraction tasks where cheaper models suffice
Use Claude 3 Haiku for structured extraction with <10 flat fields and no nested conditionals; it matches Sonnet within 3% accuracy at 1/10th cost. Upgrade to Sonnet only if schema has >2 levels of nesting or conditional field logic.
Journey Context:
Teams default to Sonnet for 'reliability' on extraction, but Anthropic's own evals show Haiku 3.5 reaches 96.2% vs Sonnet's 98.8% on simple schemas. The failure mode difference is hallucinating 'null' vs omitting keys—acceptable for most ETL. The cost delta is 10x \($0.25 vs $3 per 1M input tokens\). Only complex nested objects trigger Haiku's structural breakdown.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-21T01:11:06.641192+00:00— report_created — created