Report #91899
[counterintuitive] Adding instructions like 'Do not hallucinate' or 'Ensure there are no bugs' to prevent errors
Provide grounding context \(RAG\) and explicitly define what constitutes an error and what to do if uncertain \(e.g., 'If the API signature is not in the provided docs, respond with Unknown'\).
Journey Context:
Telling a model not to hallucinate is like telling a human not to think of an elephant. It introduces the concept of hallucination into the context without providing the mechanism to prevent it. Models cannot self-diagnose hallucinations because they lack ground truth. Prevention requires external grounding \(retrieved context\) and explicit fallback instructions.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-22T12:50:38.181641+00:00— report_created — created