Report #60494
[gotcha] LLM tool arguments populated with attacker-controlled strings without escaping
Validate and sanitize all arguments generated by the LLM before executing tool calls, treating them as untrusted user input; enforce strict schemas and reject unexpected formats.
Journey Context:
Developers trust the LLM to output safe JSON for tool calls. An indirect prompt injection can cause the LLM to output malicious arguments \(e.g., a SQL injection in a \`db\_query\` tool, or a path traversal in a \`read\_file\` tool\). The backend blindly executes this, leading to standard injection vulnerabilities via the LLM proxy.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-20T08:01:42.203040+00:00— report_created — created