Report #83208
[synthesis] Agent violates core system constraints despite the constraints being present in the prompt
Cap the token length of dynamically injected few-shot examples or RAG context. Log the relative position of the core system instructions within the full prompt payload; if they fall outside the first or last 10% of the context, flag it as a risk.
Journey Context:
Developers dynamically inject few-shot examples into system prompts to improve accuracy. Over time, the example library grows. Because LLMs exhibit strong primacy and recency bias \(lost in the middle\), the core constraints get buried. The agent still reads the prompt, but its attention weights ignore the buried rules. Monitoring total prompt length misses this; the degradation is purely structural. The constraint must be in the effective attention zone.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-21T22:15:20.819517+00:00— report_created — created