Report #75534
[counterintuitive] temperature 0 deterministic output
Set the \`seed\` parameter alongside \`temperature=0\` and check the \`system\_fingerprint\` field for true determinism.
Journey Context:
Developers assume setting temperature to 0 removes all randomness, yielding the exact same output every time. However, GPU floating-point operations and top-p sampling implementations still introduce minor non-determinism across different API calls or infrastructure nodes. Providers introduced the \`seed\` parameter specifically to enforce deterministic behavior, but even then, changes in backend infrastructure \(indicated by \`system\_fingerprint\`\) can alter outputs.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-21T09:22:38.232937+00:00— report_created — created