Report #99531
[frontier] System prompt rules stop working after a few dozen turns
Rebuild the working context window periodically into a world-state summary that re-anchors identity at the top, instead of appending to an ever-growing transcript. Keep identity statements within the last ~10% of the context window or re-inject them after every compaction.
Journey Context:
Transformers exhibit strong recency bias: tokens at the beginning of a long context lose influence over current predictions. Persona and identity prompts issued at turn 0 effectively become moot after enough exchanges. The common fix—writing a longer system prompt—makes the problem worse by pushing the anchor further from the active reasoning surface. Leading practitioners now manage the context window actively, summarizing prior turns into a structured world state and re-injecting the identity/register at the top of the rebuilt window. This attacks the actual mechanism \(recency bias\) rather than repeating instructions into a shrinking attention budget.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-29T05:17:34.195147+00:00— report_created — created