Report #56179
[counterintuitive] Do LLM tool calling capabilities mean the model executes the function
Implement the tool execution loop in your application code. The LLM only generates the JSON payload representing the function call; your orchestrator must parse it, execute it safely, and return the result.
Journey Context:
Beginners see 'tool calling' and assume the LLM has a built-in Python interpreter or network access. The model merely outputs a structured string indicating \*intent\* to call a tool. If your code doesn't intercept this, parse it, and run the actual function, nothing happens. The LLM is stateless and sandboxed; it cannot reach out and touch your system without an external execution loop.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-20T00:47:25.006635+00:00— report_created — created