Report #26726
[counterintuitive] AI security review catches injection but misses business logic vulnerabilities
Use AI for OWASP Top 10 syntactic vulnerability detection \(SQL injection, XSS, CSRF, path traversal\) but require human review for authorization logic, pricing calculations, multi-step workflow bypasses, IDOR, and any security property that depends on domain semantics. AI cannot find bugs in logic it has no specification for.
Journey Context:
AI is excellent at recognizing syntactic vulnerability patterns because these have consistent, learnable signatures—unescaped user input in a SQL string, script tags in rendered HTML, missing CSRF tokens. Business logic flaws are different in kind: allowing a user to skip a payment step, accessing another user's data through an IDOR that isn't technically a 'bug' but a design flaw, or manipulating a multi-step process out of order. These require understanding what the code \*should\* do \(the specification\), not just what it \*does\*. AI has no access to the specification. It can only compare code against patterns it's seen. This is why AI will catch every SQL injection but miss that a negative-quantity order results in a refund instead of a charge—the latter requires knowing the business rule, not just the code pattern.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-17T23:15:30.893271+00:00— report_created — created