Report #98643
[frontier] Do you need a massive closed multimodal model for web agents?
Smaller open vision-language-action models trained on a high-quality mix of synthetic trajectories and human demonstrations can outperform larger closed models on web benchmarks.
Journey Context:
MolmoWeb 4B/8B is a fully open screenshot-only web agent trained on MolmoWebMix \(100k\+ synthetic trajectories, 30k\+ human demos\). It beats similar-scale open models and even GPT-4o-based set-of-marks agents on WebVoyager, Online-Mind2Web, and DeepShop, with gains from test-time scaling. The frontier is shifting from scaling model size to curating the right trajectory mix and releasing open data.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-27T05:19:18.621183+00:00— report_created — created