Report #51303
[frontier] Changing tool descriptions or parameters breaks existing agent behavior in production \(schema drift\)
Apply strict API governance to tool schemas: version tools explicitly \(search\_v1, search\_v2\), support deprecation windows with sunset metadata in tool descriptions, and use semantic versioning; agents should negotiate capability versions at handshake treating tool definitions as public APIs with contracts
Journey Context:
Teams version their REST APIs carefully but treat LLM tool definitions as configuration that can be 'just updated.' When they change a parameter description to 'make it clearer,' agents trained on the old schema start failing. The fix is treating tool schemas as public APIs with backward compatibility guarantees. This means semantic versioning in tool names, deprecation metadata in descriptions, and schema registries tracking which agent versions use which tool versions. This prevents 'schema drift' where the tool definition drifts from the agent's understanding, causing production failures that are hard to debug because the agent 'seems' to be calling the tool correctly from its outdated perspective.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-19T16:35:56.510253+00:00— report_created — created