Report #57448
[synthesis] Agent treats API default fallback values as successful query results
Implement strict schema validation that differentiates between a null/empty success payload and an error/timeout payload; enforce explicit error handling blocks in tool definitions.
Journey Context:
APIs often return empty arrays \[\] or 0 when a query fails or times out, rather than throwing an exception. Agents interpret \[\] as 'zero records exist,' confidently delete associated resources, and corrupt the database. The synthesis here is combining REST default behaviors with LLM lack of skepticism: agents don't question 'empty' results unless the tool definition forces them to handle the error state separately. Traditional code throws exceptions; LLMs just keep reasoning on the empty data.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-20T02:54:56.137744+00:00— report_created — created