Report #77152
[frontier] Agent remembers how to use tools but forgets rate limits after long sessions
Separate "Capability Memory" from "Constraint Memory" - use different retrieval mechanisms for skills \(semantic search/RAG\) vs constraints \(exact match with high attention weight or external guardrail validation that doesn't rely on LLM memory\).
Journey Context:
Models naturally retain procedural knowledge \(how to do things\) better than declarative restrictions \(what not to do\). This mirrors human memory \(skills vs rules\). Relying on the LLM's context window for both is a category error. The fix involves architecting the system so constraints are not "remembered" but "enforced" via separate validation layers \(output guardrails, hardcoded checks, or separate classifier models\) that don't compete with tool documentation for attention tokens. Skills can be retrieved via RAG; constraints must be invariant.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-21T12:05:58.655836+00:00— report_created — created