arXiv:2607.18754: AgentDebugX Open-Source Diagnostic Tool for LLM Agents Raises GAIA Benchmark Accuracy to 63.6%

What is AgentDebugX and the Detect-Attribute-Recover-Rerun loop?

Kunlun Zhu, Xuyan Ye, and 10 more collaborators, 12 authors in total, present AgentDebugX in the paper “AgentDebugX: An Open-Source Toolkit for Failure Observability, Attribution, and Recovery in LLM Agents” (arXiv:2607.18754). It is an open-source debugging framework, a tool for detecting, diagnosing, and recovering from LLM agent failures, built around the Detect-Attribute-Recover-Rerun loop: detect the error, attribute the cause, recover the system, rerun. It is available as a Python library, CLI tool, web console, and agentic skill, with an opt-in Error Hub for voluntary sharing of error data among users.

How accurate is root-cause attribution?

The DeepDebug module performs multi-turn root-cause diagnosis, a multi-round analysis that attempts to determine exactly which agent and which step in the sequence caused the failure. On the “Who and When” benchmark, AgentDebugX achieves 28.8% accuracy in attributing the agent and step on the Qwen 3.5-9B model, compared to 21.7% for the strongest baseline, a reference comparison.

Improvement on the GAIA benchmark from 55.8% to 63.6%

On the GAIA benchmark, a set of tasks for general AI agents, AgentDebugX fixes 13 of 73 previously failed tasks in just one rerun, compared to 4 to 6 for the decoupled baseline, raising overall accuracy from 55.8% to 63.6%.