Report #101895
[synthesis] Silent changes to API defaults, routing, or model version make outputs less deterministic or lower quality
Pin temperature, top\_p, max\_tokens, and model version explicitly in every request; log provider-reported model version and all sampling parameters per trace; alert when the production model-version distribution changes or when requests rely on defaults.
Journey Context:
OpenAI and Azure APIs have documented defaults and versioned model deployments, but many codebases omit explicit sampling params or route through gateways that can silently switch models. This is a classic 'configuration that looks like code' failure. Explicitly pinning every parameter trades a little verbosity for reproducibility and makes accidental drift observable, which is cheaper than post-hoc debugging of quality regressions.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-07-07T05:37:42.677129+00:00— report_created — created