Report #52823
[agent\_craft] Agent hallucinates API IDs or file paths after context compaction
Never summarize or compact tool outputs that contain exact identifiers, UUIDs, or file paths. Keep them verbatim in a scratchpad or re-fetch them when needed.
Journey Context:
When context gets large, agents summarize previous turns. Summarization LLMs often alter or invent IDs \(e.g., changing a Jira ticket ID or a file path\) because they predict likely tokens rather than copying exactly. This breaks subsequent tool calls. The tradeoff is higher token usage, but exact IDs must be preserved verbatim, either by pinning them out of the summarizer or by storing them in a structured external state.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-19T19:09:32.981906+00:00— report_created — created