AutoMem: Memory Management as a Learnable Skill, Not an Architectural Choice

One of the long-standing challenges for AI agents is memory — how to remember what is relevant, when to discard what is old, and how to structure stored knowledge for future use. Previous approaches have mostly treated the memory architecture as a fixed design choice: engineers decide in advance on the structure and rules, and the agent follows them.

A new study from Stanford proposes a fundamentally different approach: memory management is a skill the agent can learn — and that skill should be optimized automatically, in parallel with learning the task.

What is AutoMem and how does it work?

The paper “AutoMem: Automated Learning of Memory as a Cognitive Skill” by Shengguang Wu, Hao Zhu, Yuhui Zhang, Xiaohan Wang, and Serene Yeung-Levy draws on an insight from cognitive science: metamemory, or the ability to manage one’s own memory, is a separate skill that can be practiced and improved independently of the content being remembered.

AutoMem implements that insight through two automated optimization loops running in parallel.

The first, called the Structure Loop, is responsible for the memory architecture — specifically, the prompts that describe how the agent should use memory, the schemas for organizing data, and the vocabulary of memory actions (operations such as writing, reading, and deleting files). A powerful LLM iteratively analyzes complete agent trajectories and proposes improvements to these components.

The second loop, the Proficiency Loop, focuses on the agent’s skill in using an already defined memory architecture. Successful memory decisions collected across multiple episodes become a training signal that fine-tunes the model — teaching it when and how to use memory in the most efficient ways.

Critically, neither loop requires human annotation of memory strategies. The entire system discovers what works through experience, not through explicitly programmed rules.

Results: a 32B parameter model matches frontier systems

The authors evaluated AutoMem on three procedurally generated long-horizon game environments: Crafter, MiniHack, and NetHack. These games require planning across hundreds or thousands of steps, remembering prior states, and adapting strategy — making them a natural test environment for memory capabilities.

The results are striking: AutoMem achieves 2× to 4× improvement in performance over baselines — and this exclusively through optimization of the memory system, with no changes to the model architecture itself.

Particularly noteworthy is that a 32B parameter model equipped with AutoMem achieves results competitive with frontier models of much larger scale. This is a direct illustration of the paper’s thesis: when memory architecture is co-optimized with task performance, smaller models can close the gap left by raw size.

Why co-optimization of memory and task matters

The standard approach when designing AI agents is to decide on the memory architecture in advance — during the system design phase — and then fix it. The agent then learns how to solve the task with that fixed memory structure.

AutoMem shows this is suboptimal. Memory architecture and agent skill need to evolve together — because the optimal memory structure depends on what the agent needs to achieve, and the agent’s capability is constrained by the memory structures available to it.

This perspective, inspired by cognitive psychology, raises the question of how much AI agent capability has so far gone untapped because memory was treated as a solved design problem rather than a variable to optimize.

For practitioners building AI agents for long-horizon tasks — from automated research and planning to extended collaborative projects — AutoMem suggests that memory architecture should be included in the evaluation and optimization loop, rather than left to manual design.