Report #52808
[gotcha] Insecure output handling leading to command injection
Treat LLM outputs as untrusted user input. Never pass LLM-generated parameters directly to privileged functions; use strict allow-lists and parameter validation.
Journey Context:
Developers build agents that use LLMs to generate function calls or SQL queries. If the LLM is manipulated via indirect injection to call an internal administrative API or drop a table, the application blindly executes it because it trusts the 'assistant'. This is the LLM equivalent of command injection.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-19T19:08:12.920504+00:00— report_created — created