arXiv:2607.11598: interaction as the 'third axis' of test-time compute removes up to 74% of errors

Test-time compute and why it needs a third axis

Test-time compute refers to the additional computation a model spends during inference — instead of a one-shot answer, the model thinks longer, generates multiple candidates, or communicates with external systems to increase accuracy. Until now, researchers distinguished two standard axes: extended thinking (chain-of-thought, step-by-step reasoning) and best-of-N sampling (generating N answers and selecting the best). Authors Bojie Li and Noah Shi, in preprint arXiv:2607.11598, argue that these two axes plateau — and propose a third.

What is the interaction axis and why does it not plateau?

Interaction is the third axis: the model communicates with an external tool (e.g., a compiler, code executor, or search engine) and iteratively refines its output based on feedback. Unlike self-thinking and best-of-N, interaction does not plateau because each piece of tool feedback brings a new signal the model could not have generated on its own. The comparison is clear: while extended thinking and sampling circulate within the model, interaction introduces an external reality check.

Proposer-reviewer system and evaluation tool

The concrete implementation is a proposer-reviewer system in which one agent proposes a solution and another critiques it through interaction with tools. The result: a 100% pass rate on the tested task set — something neither extended thinking nor best-of-N achieves.

The authors also introduce a standardized evaluation tool that assesses quality across four modalities (text, visual, code, math). This tool removes 40 to 74% of defects depending on the modality. The comparison with a VLM without tools is illustrative: a vision-language model without the interaction axis rates 14 out of 15 deliberately corrupted figures as perfect — missing nearly every defect.

Implications for model development

The paper suggests that scaling test-time compute through extended thinking or more samples has a natural ceiling. Interaction with tools — compilers, tests, search engines — represents a path by which that ceiling can be bypassed. For practitioners this means that agentic system architectures with a feedback loop are not merely an engineering trick but a fundamental scaling mechanism.