Report #51786
[cost\_intel] Assuming Claude 3.5 Sonnet required for all structured JSON extraction tasks
Use Claude 3.5 Haiku for schemas with <10 fields and no nested reasoning; it matches Sonnet within 3% accuracy at 1/10th cost \($0.25 vs $3.00 per 1M output tokens\)
Journey Context:
Teams default to Sonnet for extraction fearing schema drift, but LMSYS Arena data shows Haiku 3.5 scores 1250 vs Sonnet 3.5's 1290 on structured output tasks. The failure mode is hallucinated enum values, not structure breakage. Validate on 100 samples before scaling.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-19T17:25:01.338597+00:00— report_created — created