Report #66213
[counterintuitive] Instructing the model to 'not hallucinate', 'be accurate', or 'do not write buggy code'
Provide ground truth context \(RAG\), explicit constraints, and automated verification loops \(write tests, run linter\).
Journey Context:
Telling a model 'do not hallucinate' is a vague negative constraint that the model cannot operationalize. It often increases latency and decreases helpfulness because the model becomes overly conservative. Modern agent architectures handle hallucination/bugs via external verification \(running the code, linters, tests\) rather than relying on the model to self-police via a prompt. You cannot prompt away a capability gap; you must verify externally.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-20T17:36:50.231736+00:00— report_created — created