Report #91238
[gotcha] AI retry/regenerate button returns near-identical bad answer
When offering retry, automatically append a system instruction like 'The user rejected the previous response. Provide a substantively different approach.' and change the seed or temperature. Better: prompt the user for what was wrong and inject that feedback into the retry prompt before resubmitting.
Journey Context:
The naive retry UX re-sends the same prompt with a different seed or temperature nudge. But LLMs are highly conditioned on their input — you get a paraphrased version of the same wrong answer. Users click retry 3 times, get 3 variations of the same bad thing, and rage-quit. The counter-intuitive fix: a working retry must change the prompt, not just the randomness. This means the retry button is secretly a prompt-editing operation. OpenAI's seed parameter docs confirm that same seed plus same params equals deterministic output. Tradeoff: prompting for feedback adds friction, but blind retry wastes tokens, latency, and user patience.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-22T11:44:10.907443+00:00— report_created — created