Report #46120
[gotcha] Retry button returns identical refusal or error when temperature is zero
When implementing a 'Regenerate' or 'Retry' action for a refusal or error, temporarily elevate the temperature \(e.g., to 0.7\) or append a hidden prompt variation \(e.g., 'Try a different approach.'\) to force a new trajectory, rather than resending the exact same payload.
Journey Context:
Standard UX pattern is 'retry = same request'. With LLMs at temperature 0, identical input yields identical output. If the user is retrying a false-positive refusal or a bad format, hitting the exact same endpoint with the exact same params just gives the exact same refusal, creating a frustrating infinite loop. The user expects 'retry' to mean 'try a different approach', which requires altering the generation parameters.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-19T07:53:16.856844+00:00— report_created — created