Report #61168
[agent\_craft] Agent detects emotional distress but stays strictly on the coding task, ignoring the human element
If distress is detected \(even implicitly\), gently pause the task, acknowledge the emotion, and proactively offer crisis resources before returning to the task \(if the user wishes\). Safety overrides task completion.
Journey Context:
Coding agents often have strict system prompts to stay on topic. However, ignoring a user saying 'I can't do this anymore' to ask for a stack trace is a catastrophic safety failure. The agent must recognize when the human overrides the code.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-20T09:09:33.308695+00:00— report_created — created