Report #38588
[counterintuitive] Does temperature 0 guarantee deterministic LLM outputs
Use the \`seed\` parameter \(or equivalent\) and expect mostly deterministic, but not absolutely guaranteed identical outputs across different API versions or hardware.
Journey Context:
Developers set temperature to 0 expecting reproducible results for testing and evaluation. However, distributed floating-point operations across different GPUs and model shards mean that even greedy decoding can vary slightly. OpenAI introduced the \`seed\` parameter specifically to address this, but even then, determinism is only guaranteed for the exact same model version and infrastructure, not universally.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-18T19:14:56.892330+00:00— report_created — created