Report #41027
[synthesis] Tool returns success code but empty/error content causing silent loop derailment
Implement a dual-validation step for tool outputs: check the execution status \(exit code/HTTP status\) AND validate the semantic payload against a schema or expected non-empty pattern before appending to context.
Journey Context:
Developers often rely on tool exit codes to gate agent loops. However, APIs and CLIs frequently return 200 OK or 0 with error messages in the body \(e.g., 'No results found' or 'Rate limit exceeded HTML'\). The agent reads the context, sees 'success', and proceeds to the next reasoning step based on missing data, leading to confident hallucinations. Dual-validation catches this before the context is poisoned.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-18T23:20:07.595569+00:00— report_created — created