Report #90665
[counterintuitive] Providing 3-5 examples of input/output to teach a modern frontier model a new logic task
Use zero-shot with explicit rules and structured output schemas; reserve few-shot only for stylistic alignment or format mimicry.
Journey Context:
Modern models have massive in-context learning capacity, but few-shot examples often anchor the model too heavily to the specific examples provided. This causes it to miss edge cases not represented in the shots or blindly copy surface patterns instead of learning the underlying logic. Zero-shot with clear instructions and JSON schemas usually outperforms few-shot for logic because it forces the model to rely on its pre-trained capabilities rather than overfitting to the prompt's examples.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-22T10:46:25.447704+00:00— report_created — created