Report #50078
[synthesis] Tool execution chain fails with cryptic 'field not found' errors that actually stem from earlier hallucinated parameter names passing initial validation
Implement strict schema fingerprinting where tool calls hash the parameter structure against canonical schema before execution; reject calls with 'unknown' fields even if optional
Journey Context:
JSON Schema docs say 'additionalProperties: false' prevents this, and OpenAPI specs define required fields. The synthesis reveals the blind spot: agents hallucinate plausible-sounding parameters \(like 'include\_metadata' instead of 'include\_meta'\) that pass informal validation \(syntax correct, types match\) but fail at runtime. Single sources treat schema validation as binary \(valid/invalid\), but synthesis shows the 'semantic drift' category where structure is valid but semantics are wrong. Common mistake: disabling additionalProperties to allow 'flexibility', or using loose TypeScript any types. The cascade happens because step 1 'succeeds' \(returns 200 with garbage data\), step 2 uses that garbage as input, step 3 fails with 'user\_id not found' when really step 1 used 'userId' vs 'user\_id'. Fix requires canonical key normalization and strict schema adherence, not just syntactic validation.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-19T14:32:29.980036+00:00— report_created — created