arXiv:2606.25996: Autodata — an agentic data scientist that creates high-quality synthetic data (Meta FAIR)

Autodata: when an AI agent becomes a data scientist

On June 24, 2026, Meta FAIR researchers published a paper that changes the approach to one of the biggest bottlenecks in AI development — creating data of sufficient quality for training. The system called Autodata does not ask humans to manually prepare training datasets; instead, AI agents take on the role of data scientists — experts who plan, build, and iteratively improve a dataset — and perform that work autonomously.

The paper is signed by 15 authors including Jason Weston and Sainbayar Sukhbaatar (Meta FAIR), and the arXiv ID is 2606.25996.

What is synthetic data and why is it hard to do well?

Synthetic data consists of examples generated by a computer system rather than collected from humans. It is attractive due to low cost and the ability to cover edge scenarios that are too rare in the real world. However, poorly generated synthetic data can degrade a model — the so-called “model collapse” occurs when a model trains on its own outputs without quality control. This is precisely where Autodata introduces a key distinction.

How does Agentic Self-Instruct work?

The heart of the system is the Agentic Self-Instruct method — a meta-optimization loop in which the agent not only generates data, but also analyzes its own performance and adjusts its generation strategy. Unlike classic static baseline methods that create data from a fixed template, Autodata learns at each iteration what led to better or worse results and incorporates that insight into the next cycle. The result is progressively higher-quality datasets — without additional human supervision.

Tested domains and results

The researchers tested Autodata in three demanding domains:

• CS research — generating data for tasks requiring comprehension of scientific papers
• Legal reasoning — complex legal inference scenarios where errors carry high cost
• Mathematical reasoning — formal proofs and problem solving

In all three domains, meta-optimization via Agentic Self-Instruct delivered consistent uplift over static baselines — methods that generate data without iterative feedback. The paper does not report a single average number, but indicates that differences are most pronounced in domains requiring long chains of inference, where static approaches lose example diversity as difficulty increases.

Broader implications: compute-time vs. data-time

Autodata is part of a broader paradigm in which additional computing power is invested not only in inference (generating responses), but also in data preparation. Instead of a team of data engineers spending years collecting and labeling examples, an agent does this autonomously and at scale. For organizations without access to billions of labeled examples — which is most research institutions and startups — this approach potentially levels the playing field with well-funded labs that can afford massive annotation.

Availability

The paper was submitted on June 24, 2026, and is available on arXiv (2606.25996). Implementation details and any potential code release are not mentioned in the currently available version of the paper.