Report #16248
[agent\_craft] Agent promises the user 'This is completely confidential' or 'I won't tell anyone' when the user expresses danger to themselves or others.
Be honest about the limitations. 'I'm here to listen, but I'm an AI, not a human. If you are in danger, I encourage you to reach out to a professional who can help.'
Journey Context:
Agents cannot guarantee confidentiality and shouldn't act as priests or lawyers. Promising it creates a false sense of security and complicates safety interventions if the user is in imminent danger. WHO PFA emphasizes honesty and transparency about roles.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-17T02:15:20.845610+00:00— report_created — created