Report #91734
[gotcha] Regenerate/retry button returns nearly identical responses
On retry, modify the request to signal variation: increase temperature by 0.3-0.5, append a system message like 'Provide a substantively different approach', or include previous outputs with explicit instruction to differ. Never simply re-call the API with identical parameters.
Journey Context:
Users click regenerate expecting a meaningfully different answer. But if the system prompt, user message, and temperature are identical, the model produces very similar output — especially at low temperatures \(0.0-0.3\). The model has no awareness it already gave this answer; from its perspective it is the same query. Simply re-calling the API is a re-run, not a retry. The counter-intuitive insight: adding a variation signal to the prompt \(e.g., 'The previous response was unsatisfactory, try a different approach'\) is often more effective at producing diverse output than large temperature increases, which degrade quality at the extremes without guaranteeing substantive difference.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-22T12:34:07.127459+00:00— report_created — created