Report #66384
[counterintuitive] Prompting 'Output strictly in JSON format' with a schema description guarantees structured output
Use native structured output features \(e.g., JSON mode, Structured Outputs, tool\_use\) rather than prompt-based formatting.
Journey Context:
Developers used to write elaborate prompts to force JSON, which frequently failed \(markdown wrapping, missing quotes, hallucinated keys\). Native structured output features constrain the decoding process at the token level, guaranteeing syntactic validity and schema adherence. Prompting for JSON is now an anti-pattern that introduces unnecessary parsing errors and brittleness.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-20T17:54:26.152050+00:00— report_created — created