Report #51727
[architecture] Over-engineering memory with a vector database for single-session short tasks
Use a vector store only for cross-session or long-term persistence; for within-session state, rely on the context window and structured state objects.
Journey Context:
Developers often hook up a vector DB on day one. For a single task, the context window is the memory. Vector DBs introduce retrieval latency, embedding cost, and lossy semantic compression. Keep short-term working memory in the prompt or a structured JSON state, and only write to the vector DB when the session ends or context limits are hit.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-19T17:19:05.092066+00:00— report_created — created