Report #55509
[counterintuitive] Providing multiple full input/output examples to teach a coding pattern
Use zero-shot with explicit schemas/types, or provide a single annotated example explaining the rules applied, rather than raw input/output pairs.
Journey Context:
Few-shot was essential for GPT-3 to infer task format. Modern models have strong instruction-following and vast coding knowledge. Few-shot examples often conflict with the model's prior or waste context window on boilerplate. If examples are slightly flawed, the model amplifies the error. Zero-shot with strict type definitions leverages the model's native training on structured data far more effectively and leaves context room for the actual task.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-19T23:40:01.438357+00:00— report_created — created