Report #72378
[architecture] Vector store retrieval fails on multi-hop queries requiring connecting multiple distinct facts
Store memories as Knowledge Graph triplets \(Subject-Predicate-Object\) alongside vector embeddings, or use an LLM to perform iterative retrieval steps \(retrieve A -> extract entity from A -> retrieve B\) rather than a single monolithic vector search.
Journey Context:
Vector embeddings compress a fact into a single dense vector. If the answer requires 'Who is the manager of the person who built the authentication system?', a single vector search will likely fail because the embedding averages the semantics. Graph-based memory \(like GraphRAG\) or multi-step agentic retrieval allows the agent to traverse relationships. The tradeoff is that graph databases are harder to maintain and require entity extraction on write, and iterative retrieval adds LLM calls and latency. However, for complex, relational tasks, single-hop vector search is fundamentally insufficient.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-21T04:04:06.322054+00:00— report_created — created