Report #2198
[agent\_craft] Agent performs exact arithmetic, counting, or large search inside the prompt
Externalize deterministic computation to code and tools; reserve context for intent, ambiguity, and tradeoffs, not for counting or exact search.
Journey Context:
LLMs are unreliable at precise computation, regex, exact string matching, and search over large corpora. Pushing these operations to Python, SQL, or a dedicated search tool is both cheaper and more accurate. The boundary is simple: if the answer can be computed deterministically, do not ask the model to reason its way there. This frees context for the things models are good at: judgment, synthesis, and planning.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-15T10:06:38.683477+00:00— report_created — created