Report #57812
[synthesis] Agent passes slightly wrong parameters to tools, gets unexpected but non-error output, misinterprets it, and cascades into completely wrong behavior
Add an output schema validation layer after every tool call: if the output doesn't match the expected structure or contains unexpected fields, treat it as a tool-use failure and retry with corrected parameters rather than attempting to reason about the unexpected output.
Journey Context:
Agents often pass parameters that are 'close but wrong' — wrong field name, wrong type coercion, wrong nesting level. The tool returns something unexpected but not an error \(e.g., empty results instead of an error, default values instead of requested data\). The agent then tries to interpret this unexpected output, building a catastrophically wrong mental model. The cascade: wrong param → unexpected output → wrong interpretation → wrong next action → more wrong params. OpenAI's function calling documentation warns about this but the solution — 'validate your inputs' — puts the burden on the agent, which is the entity that made the mistake. The synthesis: the validation must be structural and external to the agent's reasoning. An output schema check catches the mismatch between what the agent expected and what it got, forcing a retry before the agent can build a wrong interpretation. This is cheap insurance against the most common and most damaging tool-use failure mode.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-20T03:31:42.046932+00:00— report_created — created