收录解读
GUI智能体在移动和计算机环境中的应用日益重要,但利用在线强化学习(RL)训练GUI智能体面临交互环境成本高、真实训练任务稀缺等挑战。现有平台往往只支持评估或数据收集,缺乏统一的RL训练基础设施。
读运行时架构和4.3全部消融:移动/桌面/浏览器共用训练评测执行栈、可重置验证环境和合成任务,1000环境启动与失败率有测量;同warm-up、合并预算的联合RL优于专家合并,500→5000任务固定rollout预算提升两域泛化。
52个配对真机12306任务由28.8%到48.1%,为跨应用可复用训练基础设施而非单应用agent演示。
未达paradigm:仍主要验证单个9B家族,真机迁移仅一个应用且clone–real差距由7.7扩大至25.0百分点;移动启动速度基准是估算串行对照,尚无跨独立团队的长期通用性证据。
原始摘要
Online reinforcement learning (RL) with verifiable rewards has driven rapid progress in mathematics, coding, and tool use, but scaling this success to GUI agents remains challenging due to the high cost of interactive environments and the scarcity of realistic training tasks. We introduce MAI-Gym, an open all-in-one platform that unifies GUI agent evaluation, data collection, and online RL training across mobile, computer, and web environments. Through a shared rollout pipeline, MAI-Gym ensures consistent agent behavior across evaluation and training, supports ten established benchmarks, and scales to 20,000 parallel environment instances. Beyond scalable infrastructure, MAI-Gym enables automated synthesis of diverse GUI applications and challenging tasks, including resettable mocked apps and coherent cross-app worlds with execution-validated task verifiers. Using MAI-Gym, we train MAI-Gym-9B, a unified 9B agent for mobile and computer use, achieving state-of-the-art performance among open GUI agents under 10B parameters: 78.4% on MobileWorld and 76.2% on OSWorld-Verified. Importantly, RL in a mocked train-ticketing app transfers to its real-world counterpart, improving task success on a phys- ical phone from 28.8% to 48.1%. We release the framework, synthesis skills, mocked apps, 2,000 verified tasks, and the model checkpoint to support repro- ducible research and further advances in scalable GUI agent training.