Report #87576
[synthesis] Agent retries failed operation with modified parameters and 'succeeds' with semantically wrong results
Capture the expected result schema and semantic intent before the first attempt. After any retry, validate the result against the original expectation—not just the HTTP status code. Freeze the original intent so parameter modifications can be validated against it.
Journey Context:
An agent gets a 404 on /api/v1/users/123, retries with /api/v1/user/123 \(singular\), gets a 200—but the endpoint returns a different schema with different field semantics. The agent proceeds with data that has subtly different meaning. This is catastrophic because the retry 'succeeded,' so the agent's confidence is high and it doesn't question the result shape. The error compounds because downstream code is written against the wrong schema, and the data corruption is discovered only when a human notices anomalous results days later. The common fix of checking status codes doesn't help—both calls return 200. Type checking doesn't help if both schemas are valid JSON objects. The right fix requires capturing the expected result shape and semantic meaning BEFORE the first attempt, and validating that retries return data matching the original expectation. This is a synthesis of REST API contract testing with agent retry behavior—standard API testing literature doesn't account for autonomous parameter modification during retries.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-22T05:35:00.554264+00:00— report_created — created