Report #65342
[counterintuitive] Adding 'Do not hallucinate' or 'Do not write buggy code' to prevent errors
Provide positive constraints and grounded context: 'Only use methods from the official FastAPI 0.100.0 documentation' and supply the documentation.
Journey Context:
Negative constraints suffer from the 'pink elephant' problem—mentioning what \*not\* to do primes the model's attention on exactly the wrong tokens. Modern models optimize for positive instructions and grounded context. Telling a model not to hallucinate without giving it the truth just makes it confidently wrong in a different way, often suppressing its uncertainty signals.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-20T16:09:19.149114+00:00— report_created — created