arXiv:2607.18100: SOPHIA activation steering pulls language models out of reasoning self-loops

What are self-loops in reasoning models?

Sheldon Yu and colleagues, in the paper “Can We Break LLMs Out of Self-Loops? Fine-Grained Reasoning Control with Activation Steering” (arXiv:2607.18100), identify that failed reasoning paths in language models with extended thinking — the so-called extended thinking mode — fall into self-loops, self-repeating loops in which the model repeats similar reasoning steps without real progress toward a solution. Such loops consume the token budget, the limited number of tokens allocated for the thinking process, without increasing the chance of a correct answer.

SOPHIA tracks hidden states and redirects the process

The authors propose SOPHIA (Steering Of reasoning Processes via Hidden-state Intervention and Activations), a method that classifies reasoning prefixes, the initial parts of the reasoning chain, into latent states, i.e., the model’s hidden internal representations. During inference itself, SOPHIA detects when a model enters a self-loop, and then applies a steering vector, a mathematical correction to the model’s internal activation, to redirect the reasoning process toward a new, productive direction.

Accuracy and token savings with SOPHIA versus without it

According to the authors, a model with SOPHIA steering applied simultaneously improves task accuracy and token efficiency compared to a model without the intervention. Instead of continuing to burn through the token budget on a loop it would not have escaped on its own, a model with SOPHIA abandons the unproductive path and allocates the remaining tokens to a fresh attempt at solving the task.

Why fine-grained control of the reasoning process matters

The approach shows that problems with reasoning models don’t have to be solved only by changing prompts or retraining, but also through direct intervention at the activation level during inference. For developers of tools that use models with extended thinking, this means the ability to control behavior more cheaply, without additional training.