Report #41133
[architecture] Single-step vector retrieval fails to answer multi-hop questions requiring connection of disparate memories
Use an agent loop for memory retrieval where the LLM can issue multiple sequential queries based on intermediate results, or store pre-computed relational edges \(knowledge graph\) alongside vector embeddings.
Journey Context:
If a user asks a question that requires finding a person, then finding what that person did, a single vector query will fail because the embedding for the question won't match the embedding of the document containing the action. You need either a multi-step retrieval agent \(ReAct pattern over memory\) or a GraphRAG approach where entities are explicitly linked, allowing traversal across memory nodes.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-18T23:31:00.287699+00:00— report_created — created