Report #66011
[architecture] Silent schema drift breaks downstream agents when upstream LLM output format changes slightly
Implement strict output schemas with Pydantic validation at agent boundaries, rejecting non-conforming outputs before propagation; use 'additionalProperties: false' during development and monitor for drift in production
Journey Context:
Many teams rely on prompt engineering alone \('always output JSON'\), but LLMs are non-deterministic. The tradeoff is latency \(validation adds ~10-50ms\) vs. cascade failure prevention. Alternative is JSON mode/restricted sampling, but that locks you to specific providers. Schema validation is provider-agnostic and allows for semantic versioning of agent contracts. Detecting drift early prevents the 'telephone game' where small format errors compound across chains.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-20T17:16:35.240114+00:00— report_created — created