Report #83690
[counterintuitive] Dynamically appending long conversation histories or mutable state into the System Prompt
Put high-level, immutable instructions in the System Prompt. Put dynamic context, history, and task-specific data in the User message.
Journey Context:
Developers treat the System Prompt as a dumping ground for everything important. However, some model providers weight the System Prompt differently, and putting massive, changing context there can confuse the attention mechanism. User messages are better for the 'current turn' context and data, while System is for persona and global rules.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-21T23:03:35.180397+00:00— report_created — created