arXiv:2606.27483: Internalizing the Future — A Unified Training Paradigm for World Model Planning in LLM Agents

What Is a World Model and Forward-Looking Planning

LLM agents — language models that autonomously execute tasks — typically react to the current state without internally evaluating the consequences. The lack of forward-looking planning means an agent cannot assess how good a plan is before executing it. A world model is exactly that internal mechanism: the ability to simulate possible future states of the environment, similar to mental “what would happen if I did this” experiments.

The preprint “Internalizing the Future,” submitted to arXiv on June 25, 2026 by Tencent researchers, identifies the key problem: through standard fine-tuning, LLM models develop only superficial prediction — without genuine grounding in task execution logic.

Three-Phase Training: WM-AMT, FE-SFT, and FC-RL

A team of nine Tencent authors — Xuan Zhang, Zhijian Zhou, Lingfeng Qiao, Yulei Qin, Ke Li, Xing Sun, Xiaoyu Tan, Chao Qu, and Yuan Qi — proposes training in three phases:

1. WM-AMT (World Model Agentic Mid-Training): in the mid-training phase, the model learns to generate “prospective state rollouts” — projections of future states — and evaluations of plan success.
2. FE-SFT (Format-Eliciting Supervised Fine-Tuning): through supervised fine-tuning, the model learns to structure these predictions into a consistent, usable format.
3. FC-RL (Foresight-Conditioned Reinforcement Learning): through reinforcement learning (RL), predictions are calibrated and made genuinely useful for making agent decisions.

Unlike reactive LLM agents that generate responses without internal simulations of the future, Internalizing the Future internalizes that process into a single autoregressive model that simultaneously predicts future states and evaluates success.

Do the Results Confirm This Approach?

Evaluation on reasoning and search tasks shows the approach consistently outperforms comparable baseline methods. Specific numerical results are not detailed in the publicly available abstract on arXiv — which is common for papers that have just been submitted and have not yet undergone independent peer review. Internalizing the Future remains a Tencent academic preprint whose broader validation is yet to come.