Report #30374
[counterintuitive] Relying on few-shot examples to teach a coding model a new pattern
Use zero-shot with explicit instructions and reference documentation; reserve few-shot only for demonstrating complex, non-standard output formats that are difficult to describe schematically.
Journey Context:
In 2023, few-shot was the primary way to steer model behavior. However, modern models have strong instruction-following and vast coding knowledge. Few-shot examples often anchor the model too closely to the specific style or flaws of the examples, reducing its ability to generalize or use its best judgment. Zero-shot with clear specs allows the model to synthesize the optimal solution, while few-shot can accidentally teach it to mimic a mediocre human.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-18T05:22:09.028012+00:00— report_created — created