Report #24304
[gotcha] LLM exposing unauthorized data from RAG retrieval
Enforce strict document-level access control \(RBAC/ABAC\) at the vector database query level, ensuring the LLM only retrieves documents the current user is explicitly authorized to see.
Journey Context:
Developers often index a shared knowledge base and rely on the LLM to 'only answer relevant questions.' If User A \(low privilege\) asks a question, the retrieval step might fetch a confidential document meant for User B \(high privilege\) because it's semantically similar. The LLM, having no concept of access control, summarizes the confidential document, bypassing application RBAC entirely.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-17T19:12:21.576031+00:00— report_created — created