arXiv:2607.13104: Comprehensive Survey of Self-Improving AI Agents (With Jürgen Schmidhuber)

A team of researchers led by Zhe Ren and Yimeng Chen, with the participation of Jürgen Schmidhuber — a pioneer of deep learning known for developing the LSTM architecture — has published a comprehensive survey of self-improving AI agents on arXiv. The study spans 97 pages and 12 figures, making it one of the most extensive academic surveys of the field to date.

What Is a Self-Improving Agent?

The paper formalizes a self-improving agent as an “update operator that acquires experience without human input” — an AI system that modifies its own behavior based on feedback from the environment, without manual retraining or engineer intervention. Unlike standard human-supervised fine-tuning, self-improvement is an autonomous process: the agent identifies errors, generates its own rewards or evaluation signals, and updates itself.

What Does the Survey Cover?

The authors systematize the field along three dimensions. The first is update objectives — whether the model’s own parameters change, or only the scaffold (the surrounding framework of tools, memory, and prompts). The second is the driving signals that trigger improvement: external reward, self-evaluation, contradiction in context, or comparison with previous versions. The third is evaluation — how to measure whether an agent has actually improved rather than merely changed. The survey also maps the transition from research prototypes to systems deployed in production environments.

Why Is Schmidhuber’s Involvement Significant?

Jürgen Schmidhuber has spent decades researching self-referential and self-improving systems — he set that direction in papers from the 1990s, years before the term “agentic AI” entered the mainstream. His participation gives the survey a direct link to the theoretical foundations of the field, and the 97-page format suggests an ambition to establish a reference point for researchers entering this fast-growing segment.