arXiv:2607.17641: VRR-Stop solves when an LLM agent should stop repeatedly fixing its answer

Why does a verify-repair loop sometimes worsen an answer?

Yitao Wu and colleagues, in the paper “Verify, Repair, Repeat, or Stop? Robust Stopping for Noisy Verify-Repair Loops in LLM Agents” (arXiv:2607.17641), examine a common pattern in LLM agents: the agent alternately calls a verifier, which assesses the correctness of the current answer, and a repairer, which tries to fix the answer. The authors show a paradoxical finding — if both the verifier and repairer err with non-negligible probability, each additional round of the loop need not improve the result, and can in fact worsen it, since the repairer may “fix” an already-correct answer in the wrong direction.

VRR-Stop: a 4-parameter noise model and belief filtering

As a solution, the authors propose VRR-Stop, a method that describes the behavior of the verifier and repairer with a 4-parameter noise model — the error rates of each in both directions. Based on this model, belief filtering continuously tracks the estimated probability that the current answer is correct and uses it to decide whether the agent should proceed with another round of repair or stop. In addition, VRR-Guard is defined, a fallback mechanism that takes over the decision in cases where the estimate becomes too uncertain for reliable continuation.

VRR-Stop versus a fixed five rounds of repair

On math reasoning tasks, VRR-Stop achieves a 60.6 percentage-point improvement over the common approach of a fixed five rounds of verify-repair fixing, where the fixed approach continues the loop up to a predetermined number of steps regardless of whether the answer is improving. The authors emphasize that this improvement comes at only minimal additional computational cost compared to the fixed loop, making VRR-Stop a practical replacement for agentic systems that rely on iterative verification and repair of answers.