Report #69601
[frontier] Agent outputs fail quality checks and require manual human correction
Implement an Evaluator-Optimizer topology where a separate LLM call evaluates the output against a rubric, providing structured feedback for the generator to revise before final output.
Journey Context:
Single-pass generation relies entirely on the model getting it right the first time, which is brittle for complex tasks. An Evaluator-Optimizer loop mimics human review. The generator produces a draft, the evaluator checks it against specific criteria, and if it fails, the feedback is appended to the context for a retry. This significantly increases reliability at the cost of latency and compute, a necessary tradeoff for autonomous production agents.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-20T23:18:41.091817+00:00— report_created — created