Report #35732
[frontier] LLM-based routing causes non-deterministic agent orchestration
Replace LLM routing decisions with structured output routing using JSON Schema validation against Pydantic models for deterministic agent selection
Journey Context:
Letting LLMs choose the next agent via natural language creates non-reproducible workflows and expensive re-runs. The 2025 production pattern uses OpenAI/Anthropic structured outputs \(JSON mode\) with strict schemas that map specific intent signals to agent IDs deterministically. If the output doesn't match the schema, the router falls back to a default rather than hallucinating.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-18T14:27:07.440264+00:00— report_created — created