arXiv:2607.15193: Plover Steers GUI Agents Through a Plan-Centric, Editable Approach to User Interaction
Plover is a plan-centric system for GUI automation that externalizes task plans and replanning as persistent, inspectable artifacts instead of hidden internal agent state. Its planner-executor architecture enables execution oversight and localized correction through editable plans, with a formative study of 6 participants informing the interaction design.
This article was generated using artificial intelligence from primary sources.
Preprint arXiv:2607.15193 presents Plover, a plan-centric system for GUI automation that addresses a common cause of failure in autonomous agents.
Why do autonomous GUI agents drift from user intent?
A GUI agent performs tasks through direct interaction with an interface, but dynamic layouts and unexpected dialogs push fully autonomous agents off course because their plans remain hidden and unavailable for correction.
Method: a planner-executor architecture
Plover uses a planner-executor architecture that externalizes task plans and replanning as persistent, inspectable, and revisable artifacts. This supports explicit oversight of execution, localized correction through editable plans, and screenshot-grounded interventions that preserve prior progress. A formative study with 6 participants informed the interaction design.
Why it matters
Unlike an opaque autonomous agent whose plans stay buried in internal state, Plover shows that many GUI agent failures are structurally fixable once plans are made visible — localized interventions make automation more transparent and reliable. Users can correct just the wrong step in a plan instead of aborting the whole task and restarting the agent from scratch, which directly saves time and preserves work already done.
Frequently Asked Questions
- What is a GUI agent, and why does the fully autonomous approach tend to fail?
- A GUI agent is a system that performs tasks through direct interaction with a graphical interface — clicking, typing text, navigating between screens. Dynamic layouts and unexpected dialogs push fully autonomous agents to drift from user intent, because their internal plans remain hidden and unavailable for correction.
- What does Plover's planner-executor architecture provide?
- The planner-executor architecture separates plan creation from plan execution and exposes the plan as a persistent, editable artifact visible to the user. Unlike an opaque autonomous agent, this enables localized correction and screenshot-grounded interventions while preserving prior progress.
📬 AI news in your inbox
A daily digest built your way — pick topics, sources and cadence. One-click unsubscribe.
Related news
arXiv:2607.15257: SearchOS Prevents Repetitive Loops in Search Agents with an Explicit Evidence Graph
arXiv:2607.14658: TopoAgent Replaces Linear Planning with a Dynamic Graph for Scientific Reasoning
AWS: Amazon Quick Is an Agentic AI Teammate for Sales Teams That Automates CRM and Meeting Prep