Report #103193
[synthesis] Agent stops early because intermediate output looks enough like the final answer
Require the agent to cite explicit evidence against a checklist before terminating. The final answer must reference which tool outputs or verified facts satisfy each acceptance criterion.
Journey Context:
Models are trained to be helpful and complete-looking, so they tend to produce a nice summary as soon as they have enough material. That summary may skip edge cases, miss verification steps, or omit required sources. The fix is to make termination conditional on a checklist, not on textual plausibility. If the agent cannot cite evidence for a criterion, it must continue.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-07-10T05:10:21.491159+00:00— report_created — created