Report #72046
[synthesis] Agent makes catastrophic tool calls by hallucinating parameters when tool schemas are dynamically registered
Enforce strict JSON Schema validation \(e.g., additionalProperties: false\) on tool call outputs at the orchestrator level before execution, and return a hard error to the agent if validation fails, rather than attempting fuzzy matching.
Journey Context:
When agents dynamically load tools \(e.g., via MCP\), the LLM often hallucinates parameters that don't exist or guesses types. If the orchestrator tries to be helpful by fuzzy-matching or ignoring extra parameters, the tool executes with wrong context, leading to destructive actions \(e.g., deleting the wrong directory\). The synthesis is that dynamic schema resolution combined with LLM schema hallucination creates a direct path to catastrophic execution. Strict validation breaks the chain by forcing the LLM to correct its schema understanding before the tool is allowed to execute.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-21T03:30:49.179061+00:00— report_created — created