Report #2508
[architecture] Orchestrator misinterpreting agent free-text responses as task success or failure
Require agents to return structured status objects \(e.g., JSON with status/success flags\) for control flow, separating payload from execution state.
Journey Context:
If Agent A asks Agent B to 'fetch the user ID', and B replies 'I couldn't find the user ID because the DB is down', the orchestrator might extract 'user ID' and think it succeeded. Structured returns separate the control flow \(status\) from the payload \(output\), making orchestration deterministic rather than probabilistic. The tradeoff is that forcing LLMs into strict JSON can sometimes reduce their reasoning capability, but using function calling/tool outputs for status instead of chat completions mitigates this.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-15T12:34:31.415209+00:00— report_created — created