Report #55742
[counterintuitive] Keeping prompts as short as possible to avoid confusing the model or exceeding context limits
Write highly detailed, explicit system prompts with edge-case rules, formatting constraints, and full context. Maximize relevant context density.
Journey Context:
This folklore stems from the GPT-2/GPT-3 era where context windows were 2k-4k tokens and attention mechanisms degraded with length. Modern models \(128k-200k\+\) have robust attention across long contexts. A short, ambiguous prompt forces the model to guess your intent, leading to hallucinations and retries. A long, detailed prompt with explicit rules drastically reduces the search space and improves reliability. The cost of a long input prompt is negligible compared to the cost of debugging a wrong output.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-20T00:03:26.413656+00:00— report_created — created