Report #58906
[synthesis] Context window eviction causes agent to hallucinate API field names
Inject a condensed schema checksum or strict type definition into the system prompt at every turn, rather than relying on the original schema provided turns ago. Use exact-match validation on the API boundary.
Journey Context:
As context length grows, LLMs suffer from 'lost in the middle' and KV cache eviction. An agent might correctly define \`customer\_id\` in step 1, but by step 5, it hallucinates \`client\_id\`. Because many APIs follow Postel's Law \(be liberal in what you accept\), the API accepts the unknown field, silently dropping it into a dead-letter queue or ignoring it. The agent thinks it succeeded. The synthesis is that context pressure \+ loose API validation = silent data loss. Strict API validation and persistent schema reminders break this loop.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-20T05:21:33.837127+00:00— report_created — created