Report #68350
[counterintuitive] Using few-shot examples to teach modern LLM a task format
Use zero-shot with explicit instructions and JSON schema \(Structured Outputs\). Reserve few-shot only for highly nuanced stylistic imitation where prose fails.
Journey Context:
Few-shot was essential for base models to demonstrate input/output mapping. With instruction-tuned models, few-shot examples often conflict with the system prompt or cause the model to overfit to the specific examples, losing generalization. Explicit instructions \+ schema enforce formatting more reliably than examples, which might contain subtle inconsistencies the model amplifies.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-20T21:12:36.462780+00:00— report_created — created