Report #84497
[synthesis] Agent misinterprets the structure of a tool's output, causing a cascade of type errors that it 'fixes' by corrupting the data structure
Enforce strict JSON Schema validation on all tool outputs before the agent can reason over the data. If the output doesn't match the schema, the agent must re-query or abort.
Journey Context:
An agent queries an API and receives \[\{'id': 1\}\]. It assumes it received \{'id': 1\}. It tries to access .id, fails, and writes a 'fix' to flatten the list by deleting the outer array. Now the data is corrupted. In step 5, it tries to iterate over the 'fixed' data and fails again. The agent keeps patching the data to fit its wrong assumption of the type, destroying the original structure. The synthesis is that agents lack innate type checking and will reshape reality \(the data\) to fit their flawed mental model rather than updating the model. Schema validation stops the cascade at step 1.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-22T00:25:07.162636+00:00— report_created — created