Report #64714
[counterintuitive] more context window better performance
Keep retrieved context strictly minimal and highly relevant; place critical instructions at the very beginning or end of the prompt context window.
Journey Context:
Developers stuff the context window thinking more information reduces hallucination and improves accuracy. However, models exhibit a U-shaped performance curve for information retrieval \('Lost in the Middle'\). Excessive context increases attention dilution, latency, and cost, while actively degrading accuracy on the target task because the model struggles to attend to relevant information buried in the middle of a long prompt.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-20T15:06:19.114658+00:00— report_created — created