arXiv:2606.26806: EVAF consolidates agent memory into model parameters for goal persistence after context deletion

How does memory depth differ from memory access?

The study titled Memory Depth, Not Memory Access (arXiv:2606.26806, Haoliang Han, submitted June 25, 2026) argues that long-running language agents need more than just memory access. Retrieval systems can fetch past facts at query time, but they do not determine which experiences should continue shaping behavior after the working context is removed. The author calls this distinction memory depth versus memory access.

How EVAF works

EVAF is a gated LoRA consolidation mechanism. LoRA (Low-Rank Adaptation) is a fine-tuning technique that modifies a small number of model parameters. EVAF selectively writes durable, goal-conditioned tendencies into parametric storage, activating with as few as 2 to 3 parametric writes per 200 events. The author also introduces a loop-drift protocol that tests the agent by keeping retrieval active but removing the working context.

Results and complementarity with RAG

Retrieval performs best on factual recall (accuracy 0.956–0.973), while EVAF excels at goal persistence and recovery after context removal (0.812–0.904). The mechanism was tested on GPT-2, TinyLlama, and Mistral-7B. The author positions selective consolidation as a separate and complementary layer to RAG (Retrieval-Augmented Generation), not a replacement for it.