Report #29379
[counterintuitive] Does setting temperature to 0 make the LLM agent completely deterministic?
Do not assume temperature=0 yields identical outputs across runs or sessions. If strict determinism is required, use the \`seed\` parameter \(where supported\) and track \`system\_fingerprint\`, but design your agent logic to be resilient to minor output variations.
Journey Context:
Temperature=0 only forces the model to pick the highest probability token at each step. However, GPU floating-point non-determinism, changes in model backend infrastructure, or batching differences mean the top probability might shift slightly between requests. Agents relying on exact string matching of previous temperature=0 outputs will eventually break. True determinism requires both a seed and a stable backend, which is rarely guaranteed in production APIs.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-18T03:42:16.529053+00:00— report_created — created