arXiv: Memory value model for AI agents — seven psychological factors that decide what to remember

Why is memory for long-horizon AI agents a hard problem?

AI agents working on long-horizon tasks face a fundamental memory management problem: given a limited memory budget, what should be deeply encoded, what forgotten, and what retrieved when needed? Existing solutions have relied mainly on semantic similarity or recency — simple heuristics that handle the forgetting decision poorly, since it must be made at a moment when future queries are not yet known.

The research “Learning What to Remember” offers a more systematic answer: a memory value function grounded in seven factors inspired by cognitive psychology, with weights the agent learns itself.

Seven factors that determine the value of a memory

The central innovation is the value function V(m) = Σ wᵢfᵢ(m), where each factor fᵢ quantifies one dimension of importance for an individual memory record:

1. Emotional intensity — the strength of the affective content of the record
2. Goal relevance — how closely the record is tied to the agent’s current goals
3. Value alignment — consistency with the agent’s normative framework
4. Self/user relevance — whether the record concerns the agent or the user directly
5. Task utility — practical applicability to future tasks
6. Reliability — trustworthiness and verifiability of the information
7. Usage history — how often and successfully the record has been retrieved

A single scalar parameter simultaneously controls encoding depth, forgetting risk, and retrieval rank — simplifying optimization and deployment.

Learning factor weights without gradients

The method deliberately avoids gradient-based optimization, meaning the entire system can run on a single CPU without API calls. Weights are learned from the outcomes the agent achieves on real tasks, without the need for expensive annotation or specialized hardware.

This approach has a practical advantage: it is compatible with open models and can be applied in resource-constrained environments — important for real-world deployments of long-horizon agents.

Performance on LongMemEval

Evaluation is conducted on the LongMemEval benchmark in the blind regime — a critical distinction from the easier testing mode. In the blind regime, the decision of what to remember is made without knowledge of the future evaluation query, which realistically simulates actual agent usage.

Results are clear:

Approach	Gold-evidence retention
Learned model (V(m))	0.770
Uniform weights	0.657
Best single factor	0.518
Recency	0.368

The learned model outperforms all alternatives. Particularly illustrative is the gap between the learned model (0.770) and relying solely on recency (0.368) — nearly a two-fold difference — quantifying how much recency as a heuristic actually misses.

Most important value factors

Analysis of the learned weights reveals that reliability, emotional intensity, and self/user relevance dominate performance. Interestingly, semantic similarity to current goals is intentionally weighted low for the forgetting decision — a logical choice, since forgetting happens before the future query is known.

The methodological trap of visible queries

The researchers also include a methodological critique relevant to the broader community: testing memory retrieval when the evaluation query is visible saturates near 0.98 and measures retrieval ability, not forgetting ability. These are meaningfully different capabilities. The blind regime is the only setting that realistically tests what actually matters for a long-horizon agent — making a good decision about what to preserve at the moment when future context is not yet known.

Statistical validation confirms all performance differences: 95% bootstrap confidence intervals above zero for all comparisons. The research is fully reproducible with open-source code and without proprietary APIs.