ArXiv: SWE-AGILE — How Small Models Solve the Context Explosion in Coding Agents

One of the biggest challenges for autonomous AI coding agents is “context explosion” — the more steps an agent takes, the more information it must hold in memory, and the context window fills up quickly.

The solution: dynamic context

SWE-AGILE introduces a Dynamic Reasoning Context strategy that uses two mechanisms:

• Sliding window of detailed reasoning — the agent’s last few steps are retained in full form for precise decision-making
• Reasoning Digests — compressed summaries of older steps that preserve key information without taking up too much space

This approach allows the agent to maintain the “big picture” of the project while simultaneously having detailed insight into the current task.

Impressive results with a small model

The most significant aspect of the work is that SWE-AGILE achieves a new state-of-the-art for 7-8B parameter models on the SWE-Bench-Verified benchmark:

• Uses only 2,200 training examples and 896 tasks
• Competes with significantly larger models thanks to efficient context management
• Code is publicly available on GitHub

Why is this interesting?

In a world where AI coding largely relies on enormous models with large context windows, SWE-AGILE shows that smarter context management can compensate for model size. This opens the door to more efficient and cheaper AI coding agents that can run on modest hardware.