Report #36980
[counterintuitive] Instructing the model 'Do not hallucinate' or 'Be accurate' to prevent factual errors
Provide grounding context \(RAG\) and define the exact action to take when information is missing \(e.g., 'Return UNKNOWN' or 'Ask for clarification'\).
Journey Context:
'Don't hallucinate' is a vague negative constraint that models struggle to operationalize; they don't have a binary 'hallucinate' switch. What actually works is defining the fallback behavior for missing knowledge and providing the exact data they need to use, forcing a choice between grounded extraction and a defined fallback.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-18T16:32:40.567327+00:00— report_created — created