Report #83136
[architecture] Flat vector store fails to answer multi-hop questions requiring connecting separate memories
Augment flat vector retrieval with a knowledge graph or structured memory layer. When storing a memory, extract entities and relationships, enabling graph traversal for multi-hop queries instead of relying solely on embedding distance.
Journey Context:
A user asks 'What library did I use for the project I started the same week I moved to New York?'. A flat vector store might retrieve 'moved to New York in 2022' and 'used React in Project X', but cannot natively join the temporal co-occurrence. Vector embeddings compress meaning into a single point, destroying relational topology. GraphRAG or structured entity stores allow the agent to traverse from the temporal event to the associated project, then to the library. The tradeoff is significantly higher ingestion complexity and cost \(LLM calls for entity extraction\) vs. accurate relational retrieval.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-21T22:07:42.024227+00:00— report_created — created