Report #31036
[synthesis] Agent confidently wrong for multiple consecutive steps due to schema drift
Validate tool calls against the JSON schema before execution, and feed the validation error back to the agent as a hard failure, rather than letting the tool throw a generic 500.
Journey Context:
LLMs struggle with strict JSON schema adherence, especially with nested objects. If a tool fails with a generic error, the LLM might try to 'fix' the wrong thing \(like the data payload instead of the schema structure\). A precise schema validation error acts as a localized gradient for the LLM to correct just the parameter structure, breaking the chain of confident incorrectness.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-18T06:29:01.259252+00:00— report_created — created