arXiv:2607.09375: Li Auto Presents Mach-Mind-4-Flash — 35B MoE with 3B Active Parameters
Li Auto, a Chinese automaker, has released its own foundation model Mach-Mind-4-Flash. It is a 35-billion parameter MoE model that activates only 3 billion parameters per input, and through a three-stage training pipeline achieves performance in the 100B+ model class with dramatically lower inference costs.
This article was generated using artificial intelligence from primary sources.
Chinese automaker Li Auto has released the technical report for Mach-Mind-4-Flash, its own foundation model combining compact architecture with high performance on key benchmarks — marking the entry of yet another non-tech giant into the race for sovereign AI models.
What Is MoE and Why Does Li Auto Choose This Architecture?
MoE (Mixture of Experts) is an architecture that activates only a subset of parameters — the so-called “experts” — for each input token, rather than all of them at once. Mach-Mind-4-Flash has 35 billion total parameters, but activates only 3 billion per call. By comparison, a dense model with the same number of active parameters would be a 3B model — a category typically considered insufficient for complex tasks. This architecture gives Li Auto 10–30× lower inference costs compared to competing dense models with similar performance.
Performance in the 100B+ Model Class
Through a three-stage training pipeline — combining a unified RL/OPD infrastructure, domain expert training, and Hybrid Median-length Policy Optimization — the model achieves results that exceed its active parameter count. Key benchmarks: AIME’26 92.70, placing it alongside leading models in mathematical competitions; IFBench 82.82 for instruction following; BFCL-v4 75.80 for function calling; BrowseComp-zh 72.31 for Chinese web search. Li Auto’s Foundation Model Team claims that overall performance reaches the “100B+ model class.”
Why Does It Matter That This Model Comes from an Automaker?
Li Auto is not a software company — it is primarily a Chinese OEM of electric vehicles. This move demonstrates that vertical integration of AI capabilities is spreading beyond the tech sector: automotive companies are building their own foundation models for autonomous driving, in-vehicle assistants, and internal productivity. Mach-Mind-4-Flash particularly targets the Chinese language market, as evidenced by the BrowseComp-zh benchmark. Low inference cost is critical for edge deployment in vehicles where cloud latency and cost are decisive factors.
Frequently Asked Questions
- What is MoE architecture and why does it matter for costs?
- MoE (Mixture of Experts) is an architecture that activates only a subset of parameters for each input, instead of all at once. Mach-Mind-4-Flash activates 3B out of a total of 35B parameters, meaning 10–30× lower inference costs compared to models of similar overall size.
- What are the key benchmarks of the Mach-Mind-4-Flash model?
- The model achieves AIME'26 92.70, IFBench 82.82, BFCL-v4 75.80, and BrowseComp-zh 72.31, placing it in the league of significantly larger dense models.
📬 AI news in your inbox
A daily digest built your way — pick topics, sources and cadence. One-click unsubscribe.