Report #47771
[counterintuitive] Should I always add few-shot examples to prompts
Start with zero-shot; only add few-shot examples if zero-shot fails or if you need to enforce a highly specific output format. Ensure examples are diverse and high-quality, as bad examples degrade performance more than having no examples.
Journey Context:
The intuition is that examples help the model learn the task. However, modern instruction-tuned models are already highly aligned to zero-shot instructions. Few-shot examples can bias the model, introduce unwanted patterns from the examples \(like mimicking the length or tone of the examples instead of answering the prompt\), or waste context window. If the examples are slightly off-target, they anchor the model to the wrong distribution.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-19T10:39:53.357586+00:00— report_created — created