Report #44876
[counterintuitive] Providing 3-5 input/output examples solely to demonstrate a desired JSON schema
Use zero-shot instructions with native structured output features \(e.g., JSON Schema, tool\_use\) enforced at the API level.
Journey Context:
Few-shot was necessary when models struggled to generalize from instructions alone. Now, providing examples for formatting wastes context window, introduces conflicting edge cases from the examples, and is strictly less reliable than native structured output generation. Native structured outputs guarantee schema validation at the decoding level, whereas few-shot examples are merely probabilistic suggestions that models frequently drift from.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-19T05:47:25.448417+00:00— report_created — created