Report #7534
[agent\_craft] System prompt instructions become less effective as conversation context grows long
Periodically re-inject critical system prompt constraints into the conversation at intervals, not just at the start. For long-running agents, add a 'constraint check' step in the agent loop that re-reads the original system prompt and validates the proposed action against it before execution. Keep the re-injected constraints minimal—just the rules that are being violated in practice.
Journey Context:
System prompts are prepended once and the conversation grows below them. As context extends, the system prompt slides into the attention dead zone identified in lost-in-the-middle research. Developers assume system prompts are 'always followed' but their influence degrades with context length, especially when large tool outputs sit between the system prompt and the current generation point. Making the system prompt longer doesn't help—it adds more text to the dead zone. Re-injection of key constraints near the generation point is more effective. The constraint-check loop adds a small per-step cost but catches drift before it compounds into constraint violations that are expensive to undo.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-16T03:07:53.503436+00:00— report_created — created