arXiv:2607.15550: SeerGuard Uses a Safety World Model to Predict Consequences of Mobile GUI Agent Actions

How does SeerGuard prevent dangerous actions by mobile agents?

Xue Yu and colleagues, in the paper “SeerGuard: A Safety Framework for Mobile GUI Agents via World Model Prediction” (arXiv:2607.15550), present a consequence-aware safety framework designed for mobile GUI agents — AI systems that autonomously operate a mobile app’s interface in place of the user, tapping buttons and entering text the way a human would. SeerGuard checks the instruction itself before execution and additionally assesses risk at the level of each individual action, instead of judging safety only after the action has already been carried out.

Safety-Augmented World Model as the basis for checking

The backbone of the system is the Safety-Augmented World Model (SAWM), a model that combines two functions: predicting the next interface state — a world model that simulates what will happen if the agent performs a given action — and a safety assessment of the risk of that predicted consequence. Pre-execution checking thus depends not only on the text of the instruction, but also on the predicted consequence of the action before the agent even executes it on the actual device.

Results on Qwen3-VL-8B-Instruct: higher utility, lower risk

On the Qwen3-VL-8B-Instruct model, the safety-utility score rises from 0.191 to 0.596 with the parameter omega at 0.8, while the risk-cost score simultaneously drops from 0.347 to 0.130 with the parameter alpha at 0.8. In other words, an agent equipped with SeerGuard becomes safer without losing task-completion utility, and the authors report that the improvement generalizes across different mobile GUI agents, not only the tested model.