arXiv:2607.11307: ToMap — multi-agent proof autoformalization +19% above SOTA
Autoformalization is the automatic translation of natural-language mathematics into a machine-verifiable formal form. The ToMap pipeline by Tian-Shuo Liu and collaborators achieves a 19.0% improvement over the previous SOTA method on the ProofFlowBench dataset. The key innovation is concentrating test-time compute on the Decomposer as the bottleneck instead of distributing it evenly.
This article was generated using artificial intelligence from primary sources.
What is autoformalization and why is it hard
Autoformalization is the automatic translation of mathematics written in natural language into a machine-verifiable formal form — such as the Lean or Isabelle languages — that a computer can verify without human review. The problem is exceptionally demanding: natural language is ambiguous, mathematical proofs are rigorous, and any logical error renders the formal representation invalid. Previous methods had limited results because they distributed resources (test-time compute) evenly across all pipeline steps — regardless of which step was actually the bottleneck.
ToMap: three agents, one focus
Tian-Shuo Liu and collaborators propose ToMap (Test-time Optimization for Multi-Agent Proof autoformalization): a pipeline of three specialized agents. The Decomposer breaks the mathematical text down into atomic steps. The Formalizer translates each step into a formal language. The Prover verifies the consistency and correctness of the entire proof.
The key innovation is not the architecture itself but the resource allocation: the authors identify the Decomposer as the bottleneck — the hardest and most important step — and direct disproportionately more test-time compute to it. Comparison with even distribution shows a clear advantage of the focused approach.
Results on the ProofFlowBench dataset
On the ProofFlowBench dataset — which measures syntactic correctness and semantic fidelity of formalized proofs — ToMap achieves a +19.0% improvement over the previous SOTA (state-of-the-art) method. This is a measurable advance in a field where every percentage point carries significant practical weight: formally verified mathematical proofs have applications in software verification, cryptography, and education.
The broader message: where to allocate compute
ToMap illustrates a principle that extends beyond autoformalization: even distribution of resources across a pipeline is not an optimal strategy. Identifying the bottleneck and concentrating compute there yields disproportionate gains. This insight is relevant for any multi-agent system operating under a constrained inference budget.
Frequently Asked Questions
- What is mathematical proof autoformalization?
- Autoformalization is the automatic translation of mathematics written in natural language into a machine-verifiable formal form — such as Lean or Isabelle — that a computer can verify without human review.
- What is ToMap and what are its results?
- ToMap is a three-agent pipeline — Decomposer, Formalizer, and Prover — that achieves a 19.0% improvement over the previous SOTA method on the ProofFlowBench dataset, measuring syntactic correctness and semantic fidelity.
📬 AI news in your inbox
A daily digest built your way — pick topics, sources and cadence. One-click unsubscribe.