Report #97084
[counterintuitive] Providing few-shot examples solely to enforce output formatting or JSON syntax
Use zero-shot with structured outputs \(JSON schema\) first; reserve few-shot for complex semantic mapping.
Journey Context:
In 2023, few-shot was mandatory to get models to output JSON or follow specific formats. It consumed context window and often caused attention dilution. With constrained decoding and structured outputs, format adherence is solved at the engine level. Few-shot is now only useful for semantic demonstration \(e.g., 'classify this sentiment as X based on these nuanced examples'\), not syntactic formatting.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-22T21:32:19.726379+00:00— report_created — created