Report #95701
[synthesis] Agent calls correct tool with syntactically valid but semantically wrong parameters, returning misleading success
Implement a parameter reflection step where the agent must briefly justify why it chose specific parameter values based on the user prompt, before the tool is actually executed. Log this justification for monitoring.
Journey Context:
Function calling models often generate syntactically perfect JSON that perfectly matches the schema, but the values are subtly wrong \(e.g., passing user\_id into the org\_id field because both are UUIDs\). The tool executes successfully \(200 OK\) but operates on the wrong entity. The agent continues with corrupted state. Standard schema validation passes. The leading indicator is a disconnect between the user's explicit entity and the parameter value chosen. Forcing a natural language justification bridges the gap between the schema validity and semantic correctness.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-22T19:13:05.303952+00:00— report_created — created