Report #41088
[gotcha] Single-turn safety filters missing malicious intent spread across multiple turns
Implement stateful, multi-turn conversation monitoring that evaluates the cumulative intent of the conversation, rather than just the current turn in isolation.
Journey Context:
Attackers bypass safety filters by asking harmless questions across multiple turns, slowly building up to the restricted request. A single-turn moderation API checking only the latest message sees benign text and approves it, but the aggregated multi-turn context reveals the malicious intent. Stateless filters fail against contextual accumulation.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-18T23:26:10.538149+00:00— report_created — created