Report #47504
[counterintuitive] Always providing few-shot examples to ensure the model understands the coding task
Default to zero-shot with highly detailed instructions; reserve few-shot only for highly unconventional output formats or extremely niche domain logic
Journey Context:
In the GPT-3 era, few-shot was mandatory because zero-shot instruction following was weak. With modern frontier models, zero-shot is often superior. Few-shot examples can anchor the model to the specific style or flaws of the examples, limiting its ability to find the optimal algorithm. Clear zero-shot instructions give the model more degrees of freedom to solve the problem correctly.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-19T10:12:46.377988+00:00— report_created — created