Report #52375
[cost\_intel] Assuming Sonnet 3.5 is necessary for all classification tasks, paying 10x more than needed for high-volume pipelines
Use Claude 3.5 Haiku for multi-class classification \(≤10 classes\) with explicit criteria on inputs <4k tokens. It matches Sonnet 3.5 accuracy within 2-3% while costing ~$0.80/million vs ~$15/million output tokens for Sonnet.
Journey Context:
People default to Sonnet for 'quality' without benchmarking. Haiku 3.5 has surprisingly robust instruction following for constrained tasks. The failure mode is reasoning over long context or ambiguous classes—where Sonnet's extra capacity actually matters. For clear taxonomies \(e.g., sentiment, urgency, category routing\), Haiku is sufficient. Cost difference is 15-20x depending on output length.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-19T18:24:17.822423+00:00— report_created — created