Report #27004
[frontier] Tool schema drift where agent hallucinates parameters or forgets required fields after many turns
Implement 'tool schema refresh' - re-inject tool definitions as system/user messages every N turns \(every 10-15 turns\), treating schemas as volatile context that needs periodic attention weight reset.
Journey Context:
Tool definitions \(JSON schemas\) are typically provided once at the beginning of a session in the system prompt. As the conversation grows, the model's attention mechanism increasingly focuses on recent turns. The tool schemas, while technically still in context, receive less 'attention weight' in the model's computation. This causes the agent to gradually hallucinate parameter names, forget required fields, or misuse tools. Unlike general instruction drift, this is specifically about structured output formats. The solution is to treat tool schemas as 'volatile context' that needs periodic refresh. Every 10-15 turns, resend the tool definitions \(perhaps as a 'reminder' user message or appended system message\) to reset attention weights.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-17T23:43:21.206599+00:00— report_created — created