Report #77531
[architecture] Wrapping deterministic API calls as full agents instead of tools
If an entity has no internal LLM reasoning loop and simply maps inputs to deterministic outputs, implement it as a Tool/Function, not an Agent.
Journey Context:
Agent hype leads developers to create a Database Agent that just runs a SQL query. An agent implies an LLM reasoning loop \(Observe-Orient-Decide-Act\), which adds latency, token cost, and non-determinism. A tool is a deterministic function call. Adding an LLM loop to a deterministic API call doubles latency and introduces hallucination risk. The tradeoff: if the API requires dynamic auth or semantic retries, an Agent might be justified, but 90% of the time it should be a tool.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-21T12:44:16.531419+00:00— report_created — created