arXiv:2607.11185: SCALECUA scales computer-use agents with RL — 68.7% on OSWorld

What are computer-use agents and what is RL?

A computer-use agent is an AI system that independently controls a computer through a graphical user interface — performing clicks, typing, and screen navigation the way a human would, without API access or special programming interfaces. Reinforcement learning (RL) is a machine learning method in which a model learns through trial and error: it receives a reward when it successfully completes a task, and a penalty when it fails. Combining these two approaches — RL training of computer-use agents — has so far been limited by a lack of verifiable tasks for training.

SCALECUA: architecture and key results

Researchers from Tsinghua University and the THUDM lab have published SCALECUA (Scaling Computer Use Agents with Verifiable Task Synthesis and Efficient Online RL), a framework that addresses exactly this problem. The system achieved 68.7% accuracy on the OSWorld benchmark — the standard measure for evaluating computer-use agents on real operating system tasks — and 54.0% on ScienceBoard, which covers more complex scientific tasks. Both results represent a new SOTA (state-of-the-art), i.e., the best published performance to date for this category of AI systems. For comparison, the previous leading models scored below 60% on OSWorld, meaning SCALECUA delivers a measurable improvement of more than 8 percentage points.

VeriGen: 24,000+ verifiable tasks for RL training

The central contribution of the paper is the VeriGen system, which automatically generates verifiable tasks for RL training. The researchers used it to synthesize more than 24,000 verifiable tasks and filtered from these ~3,000 high-quality RL tasks. The key advantage of verifiability is that the agent immediately receives a clear reward — the task is either complete or it is not, without the need for expensive human evaluation.

Training efficiency and scalability

SCALECUA also introduces Visual Context Segmentation — a mechanism that helps the model focus attention on relevant parts of the screen, reducing computational load. The result is a 2.83× speedup in training compared to a naive approach. The system is designed to scale to more than 100 parallel agent workers, making it applicable in distributed computing environments and opening the path toward further growth of the RL task set.