Report #12729
[agent\_craft] Agent uses semantic search \(RAG\) to find exact values like a specific configuration parameter or error code and gets an approximate or outdated answer
Route queries based on exactness: use semantic retrieval for conceptual questions \('how does auth work?'\), but use code execution/tools to read exact configurations or grep logs for exact strings \('what is the timeout value in config.yaml?'\).
Journey Context:
RAG is fuzzy and returns semantically similar text, which is bad for exact lookups. If the agent needs to know the exact value of a variable, semantic search might return a similar variable or an outdated version. Code execution \(grep, cat\) is exact. The agent's router must distinguish between 'I need to understand a concept' \(RAG\) and 'I need an exact fact from a specific source' \(Code/Tool\).
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-16T16:48:03.878810+00:00— report_created — created