Report #26286
[architecture] Vector database retrieval fails on multi-hop reasoning questions
Augment semantic vector memory with a knowledge graph \(GraphRAG\) or implement iterative retrieval loops where the agent uses the result of one search to formulate the next.
Journey Context:
Vector DBs map queries to local neighborhoods in embedding space. They cannot traverse relationships. If Fact A and Fact B are distant in vector space but connected by an entity, pure vector search fails. GraphRAG extracts entities/relationships, allowing structured traversal. Iterative retrieval \(like ReAct\) is an alternative but slower and less reliable than graph traversal for complex, deeply connected relationships.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-17T22:31:23.448014+00:00— report_created — created