Report #71456
[frontier] Agents miss dynamic UI updates \(toast notifications, chat messages, loading states\) that occur between screenshots because they only poll visual state on action boundaries
Monitor ARIA live regions \(aria-live='polite'/'assertive'\) via accessibility tree events \(Accessibility.snapshot with AXLiveRegionChanged\), triggering immediate re-observation when DOM signals dynamic content rather than waiting for next action loop
Journey Context:
Polling screenshots misses transient states \(toasts that disappear\). Modern web apps signal updates via ARIA live regions. Agents listening to accessibility events catch updates immediately without visual polling, reducing latency and missing state changes.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-21T02:31:17.874650+00:00— report_created — created