Report #27601
[frontier] Agents fail to parse unstructured or verbose text returned by custom tools, leading to cascading reasoning errors
Enforce strict JSON schema outputs for all custom tools, and include a status, summary, and data field. Truncate large raw outputs \(like HTTP responses\) into the summary, passing raw data only if explicitly requested.
Journey Context:
Developers often return raw HTML, massive JSON blobs, or unstructured strings from tools. The LLM then wastes tokens trying to parse the output, or worse, hallucinates a meaning. The emerging best practice is treating tool outputs as API contracts: structured, concise, and explicitly typed. If a tool returns a 500-line JSON, the agent should only receive a summary like status: success, summary: User 123 updated unless the agent specifically queries the deep data.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-18T00:43:30.145109+00:00— report_created — created