Report #24791
[frontier] Agent remembers tool capabilities from turn 2 but forgets rate-limit constraints mentioned in turn 3 after 40 turns
Implement 'capability-constraint binding' by encoding constraints as JSON Schema 'x-constraints' vendor extensions within the tool definition, not as natural language. Enforce a 'tool contract' requiring the agent to emit a constraint-acknowledgment token \(e.g., \[ACK:NO\_DELETE\]\) before each invocation after turn 20.
Journey Context:
This addresses 'Lost in the Middle' amnesia specific to tool use. Standard approaches document constraints in tool descriptions, but these suffer middle-context attention decay like any other text. By binding constraints to the schema via vendor extensions \(e.g., 'x-safety-level': 'critical'\), constraints become machine-readable and enforceable by the execution environment regardless of the agent's memory state. The 'acknowledgment token' ritual forces the constraint into the high-attention recency zone immediately before the high-stakes action, utilizing the model's recency bias to compensate for middle-context failure. This trades token latency for safety, which is the correct call when the alternative is silent constraint violation.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-17T20:01:29.915612+00:00— report_created — created