Report #65611
[frontier] Agents hallucinate tool names or parameters causing parse failures and expensive retry loops
Enforce JSONSchema constraints at the tokenizer level using Outlines, Instructor, or llama.cpp grammars for all routing decisions and tool calls
Journey Context:
Regex/json repair is fragile; structured generation constrains logits to valid JSONSchema, guaranteeing valid routing keys and tool arguments on first generation, eliminating retry loops and reducing token consumption by up to 40% in high-frequency agent loops
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-20T16:36:26.938887+00:00— report_created — created