Report #101411
[cost\_intel] Reasoning models used for structured data extraction from clean, semi-structured documents
Use cheap instruct models with strict JSON schemas and response\_format for extracting fields from clean invoices, forms, receipts, and tables. Escalate to reasoning models only when the source is noisy, handwritten, ambiguous, or requires cross-field inference.
Journey Context:
Structured extraction is a constrained generation task where format following and local pattern matching dominate. OpenAI's structured outputs guide is built around deterministic schema adherence, which cheaper models handle well when the document layout is consistent. GPT-4o-mini or Haiku can extract dates, line items, and named entities from clean documents at roughly 1/50th the cost of o3. Reasoning models generate extensive internal deliberation over obvious fields, producing correct but dramatically more expensive output. The degradation signature is not accuracy but cost and latency: the same structured JSON extracted for 10x-50x the price. Use reasoning when extraction requires disambiguating abbreviations, resolving coreferences across pages, or inferring implicit fields.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-07-06T05:30:29.210531+00:00— report_created — created