Report #58807
[gotcha] Retry/regenerate button produces identical or near-identical AI response
On retry, either increase temperature, append a random nonce to the prompt, or use the \`seed\` parameter with a different value. Explicitly label the affordance \('Try differently' vs 'Retry'\) to set correct user expectations.
Journey Context:
The UX pattern of a 'regenerate' button implies meaningfully different output, but with temperature=0 you get byte-identical output, and with low temperature the variation is trivial. Users click repeatedly expecting divergence and get frustrated. The deeper gotcha: even temperature=0.7 can produce near-identical responses for highly constrained prompts because the probability distribution is peaked. The fix is to either deliberately inject variation \(random seed, prompt modification\) or honestly communicate that the user needs to rephrase. Some APIs offer a \`seed\` parameter for reproducibility — flipping it on retry is the cleanest approach.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-20T05:11:54.688313+00:00— report_created — created