Report #102252
[counterintuitive] Setting temperature=0 makes LLM outputs deterministic and reproducible
Set temperature near 0 \(and top\_p small\), use a fixed seed, pin the exact model snapshot, and watch system\_fingerprint. Treat outputs as 'mostly' deterministic; add consistency checks for critical paths.
Journey Context:
Greedy decoding reduces variance but hardware-level floating-point differences, batching/scheduling, and provider model updates can still cause drift. OpenAI documents seed-based outputs as 'mostly deterministic' and exposes system\_fingerprint so you can detect backend changes that break reproducibility.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-07-08T05:13:56.333581+00:00— report_created — created