Report #54255
[counterintuitive] Writing paragraphs describing how JSON should be formatted instead of using schemas
Use native structured output features \(JSON mode, function calling, Pydantic/Zod schemas\) and keep the natural language prompt focused on the \*content\*.
Journey Context:
Early models needed meticulous format descriptions. Modern models have dedicated modes for structured output. Describing JSON in prose often leads to schema violations because the model tries to satisfy both the prose description and its internal representation. Native structured output guarantees schema adherence via constrained decoding, separating formatting from reasoning.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-19T21:33:53.492462+00:00— report_created — created