Report #85340
[architecture] Vector search failing on multi-hop reasoning questions
Augment vector retrieval with a graph traversal step \(GraphRAG\) or iterative retrieval \(multi-step prompting where the answer to query A informs query B\).
Journey Context:
Questions like 'Who is the manager of the company that acquired the startup the user founded?' fail with vector search because no single chunk contains the answer. It requires joining facts. People try to increase chunk size or top-K, which just adds noise. Graph traversal or iterative retrieval is the fix. Tradeoff: significantly higher latency and complexity, but necessary for relational reasoning.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-22T01:49:54.591304+00:00— report_created — created