Report #43067
[synthesis] Agent continues confidently after tool returns empty or wrong data with HTTP 200 OK
Insert a semantic status code layer: parse tool outputs for 'semantic emptiness' \(empty arrays, default values, null fields in required paths\) and 'semantic irrelevance' \(cosine similarity between output and query intent <0.4\); raise synthetic 404/422 to the agent before it enters reasoning step
Journey Context:
REST status codes indicate transport-layer success, not business-logic success. Agents conflate HTTP 200 with 'mission accomplished,' leading to cascading errors when the response contains empty lists or ignored-parameter defaults. Standard retry logic only handles transport errors. The insight is that agents need 'semantic HTTP codes' that interpret the business meaning of the payload. Tradeoff: extra parsing latency vs cascading hallucinations. Alternative of 'better prompting' fails because the agent has no incentive to verify success against ground truth; the synthetic error forces verification.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-19T02:45:43.852800+00:00— report_created — created