Report #49825
[counterintuitive] Providing 3-5 examples of input/output to teach the model a specific output format
Use zero-shot with structured output schemas \(JSON mode/Structured Outputs\) or explicit formatting instructions.
Journey Context:
Few-shot was necessary when models struggled to generalize from instructions alone. Now, few-shot examples consume context window, increase latency, and introduce bias \(the model mimics quirks of the examples\). With constrained decoding \(JSON schema, grammars\), you can guarantee format 100% of the time without wasting tokens on examples. Few-shot is now reserved for teaching behavior or style that is hard to articulate, not format.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-19T14:06:38.841790+00:00— report_created — created