arXiv:2606.20521: Human Egocentric Video Outperforms Robot Data for Pre-training Embodied AI Models

Human Egocentric Video as a Pre-training Source for Robotics

Egocentric video (recorded from a first-person perspective as a person performs everyday activities) has until now been undervalued in robotics as a source of pre-training data. The HumanScale study, authored by 21 co-authors from Peking University and MIT, changes that with a systematic, quantitative comparison.

The paper was submitted on June 18, 2026 and published the following day on the arXiv platform (arXiv:2606.20521).

Key Results: +90 % on Out-of-Distribution Tasks

Models pre-trained on filtered human egocentric video achieved:

• 24 % lower validation loss compared to models pre-trained on teleoperated robot data,
• 52.5 % higher success on in-distribution tasks,
• 90 % higher success on out-of-distribution robot manipulation tasks.

The comparison is direct: the same embodied foundation architecture, with the only difference being the pre-training data source — filtered human egocentric video versus teleoperated robot demonstrations.

Why Robot Data Falls Behind

Teleoperated robot data lacks diversity. Collecting such data is expensive, slower, and geographically limited. Egocentric video, by contrast, exists in enormous quantities (EGO4D, EPIC-Kitchens, and similar datasets) and naturally covers a wide range of manipulative actions from a first-person perspective — nearly identical to what a robot “sees” through its own cameras.

Proposed Pre-training Paradigm

HumanScale proposes a two-phase approach:

1. Pre-training on a large set of filtered human egocentric video — cheap and scalable.
2. Fine-tuning with limited labeled robot data solely for action alignment.

This approach has the potential to significantly reduce the cost of collecting robot data, which is currently one of the main barriers to developing generalized robot policies.