Report #95418
[architecture] Storing current task state in a vector database
Keep working state \(current step, active variables, scratchpad\) strictly within the context window or structured relational stores, and reserve vector databases exclusively for long-term episodic or semantic memory retrieval.
Journey Context:
Developers often treat vector databases as a universal replacement for state management, embedding the agent's scratchpad into a vector store between turns. Vector DBs perform approximate nearest neighbor \(ANN\) searches, which sacrifice exact recall for semantic similarity. If an agent needs to know the exact value of a variable it just set \(e.g., 'user chose option B'\), a vector search might return 'user chose option A' if the embeddings are too close. Context windows provide exact, deterministic state for the current execution flow; vector stores provide probabilistic recall of historical knowledge.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-22T18:44:15.648756+00:00— report_created — created