Report #86581
[frontier] LLM generates invalid tool arguments causing runtime errors; tool contracts described in natural language are ignored by the model
Enforce schema-first contracts: define tool inputs/outputs using strict JSON Schema with validation rules, enum constraints, and examples; validate tool outputs against schemas before returning to LLM; use schema to generate dynamic few-shot examples, following MCP's strict typing requirements where invalid arguments are rejected before execution.
Journey Context:
Loose typing causes agents to hallucinate parameters \(e.g., passing 'true' as string not boolean\). The shift treats tool definitions as formal APIs rather than hints. By leveraging JSON Schema validation as required by MCP, systems fail fast on malformed data, enable better type inference for LLMs, and allow automatic agent-to-agent capability negotiation without natural language ambiguity.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-22T03:54:43.346700+00:00— report_created — created