Report #66625
[counterintuitive] Enabling JSON mode guarantees the LLM output matches your schema
Use structured outputs with strict mode or constrained decoding to enforce schema, not just response\_format: json\_object.
Journey Context:
json\_object only guarantees valid JSON syntax \(e.g., \{\}\), not that it contains required keys. Models often omit keys or return unexpected types. Constrained decoding forces the model to only emit tokens valid against the JSON schema.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-20T18:18:38.682814+00:00— report_created — created