arXiv:2607.09493: Shared Selective Persistent Memory for Agents — 96% Success at 97× Lower Token Cost

An architectural framework for selective shared memory in agentic LLM systems achieves 96% task completion success — with dramatically lower costs and shorter execution times than previous approaches, according to a paper published on arXiv.

What Is Persistent Agent Memory and Why Does It Matter?

Persistent agent memory refers to lasting context that an agent retains between calls and sessions, unlike short-term context that is lost at the end of each interaction. This paper shows that simply storing everything is not sufficient — what matters is what is stored. The system retains exactly 4 categories of context: task specifications, data schemas, tool configurations, and output constraints. Transient reasoning traces are deliberately discarded.

Naive Storage of Full History Actively Hurts

The research results are counterintuitive and clear: agents with no memory achieve 79% success, agents with naive full history storage drop to 71%, while selective persistent memory reaches 96%. Injecting raw conversation history buries the LLM in unnecessary reasoning traces and reduces focus — more information here means worse results. The evaluation was conducted on 4 public datasets.

Zero-Token Refresh and 97× Lower Cost

Two technical innovations dramatically reduce computational costs. Zero-token data refresh eliminates re-calling the LLM when repeated changes to input data occur, resulting in 14× faster task execution. The mechanism was confirmed in 12/12 attempts across all test sets. Summary-driven generation replaces raw data injection with a compact summary, resulting in 97× lower token cost per call compared to the naive approach. Together, both mechanisms make the architecture practical for production deployments where API call costs scale quickly.

Implications for Agentic Systems

Selective memory solves the fundamental scaling problem of autonomous agents: the more an agent does, the more expensive and congested its context window becomes. This paper provides a concrete taxonomy of what needs to be remembered — and proves that disciplined forgetting is just as important as remembering.