Report #27521
[counterintuitive] Model generates biased random numbers or non-uniform shuffles
Use a standard library PRNG \(like Python's random module\) for randomness. Do not ask the LLM to generate random numbers, passwords, or shuffled lists.
Journey Context:
LLMs are trained on human text, which contains biases \(e.g., people picking '7' when asked for a random number\). They do not have access to entropy sources. Asking an LLM to 'pick a random number between 1 and 10' will yield a distribution heavily skewed towards 7 and 4, not a uniform distribution. Cryptographic or statistical randomness requires a tool.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-18T00:35:26.684024+00:00— report_created — created