Report #13195
[architecture] Storing contradictory facts in the vector store which causes the LLM to flip-flop on answers
Implement an upsert/deduplication step using LLM-assisted conflict resolution before writing to the memory store. Search for existing facts on the same entity, and update rather than append.
Journey Context:
Append-only memory stores are the default, but they quickly become toxic. When a user updates their preferences, the agent writes a new vector, but the old vector remains. During retrieval, both are returned, confusing the LLM. Alternatives like TTLs help but don't solve immediate contradictions. The right call is a 'read-before-write' pattern where the agent checks for existing related memories and merges them before saving.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-16T18:09:34.526819+00:00— report_created — created