Report #102351
[synthesis] Rolling back an AI feature fails because model, prompt, context store, and feedback data versions are coupled
Version the full inference artifact—model weights, system prompt, retrieval index snapshot, tool schemas, and evaluation corpus—as one atomic release; test rollback end-to-end before shipping.
Journey Context:
Software rollbacks revert code and data schema. AI systems bundle weights, prompts, retrieved context, tool states, and human feedback loops. Reverting the model without reverting the prompt, or the index without the feedback data, creates inconsistent behavior. Teams discover this during incidents when a 'simple' rollback makes outputs worse.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-07-08T05:24:04.007946+00:00— report_created — created