arXiv:2605.18747: Code as Operational Substrate — A New AI Agent Paradigm

A team of 41 researchers from UIUC, NVIDIA and collaborating institutions has published a survey that reconceptualizes the role of code in AI systems: code is not merely what an LLM generates — code is the infrastructure within which an agent thinks, acts and verifies its own conclusions.

What Is an Agent Harness?

In classic LLM usage, the model receives a prompt and returns text. In the agent harness paradigm, code takes on three intertwined functions. As a harness interface it defines the interface between the agent and the environment — specifying what actions are available, how state is modeled, and how the agent receives feedback. As a harness mechanism it enables planning, memory management and tool use within an executable framework that can be reproduced and audited. As a multi-agent substrate, shared code becomes the coordination medium between multiple agents — one agent can review, test or refute another’s conclusion through shared code as a common ground truth.

This three-layer architecture means that a code execution error is not a failure — it is a signal. An LLM that receives an AssertionError or TypeError from a sandbox gets deterministic feedback it can use to correct its reasoning, rather than a vague subjective evaluation.

Why Is This a Paradigm Shift?

Previous frameworks separated “reasoning” (what the LLM does in text) from “action” (what the agent does in the environment). This paper argues that is a false boundary — executable code unifies both. When an agent writes a Python loop searching a solution space, it simultaneously plans (code structure), acts (execution) and verifies (assert statements, tests). There is no pause between thinking and checking.

The researchers emphasize that this holds from the simplest coding assistants to embodied robots: across all domains, code is the common denominator that makes agent behavior repeatable, transferable, and auditable. Code is, they argue, the only formal substrate that satisfies all three conditions simultaneously.

Where Do Open Questions Remain?

The authors identify six critical challenges. Agent evaluation still relies too heavily on task-level metrics rather than the quality of the reasoning process itself. Verification under incomplete feedback — when a sandbox cannot cover all edge cases — remains unsolved. Particularly highlighted is regression prevention: how to ensure that an agent that learns a new skill does not degrade old ones? In multi-agent settings, maintaining consistent global state through shared code poses fundamental synchronization challenges. Finally, for safety-critical applications, human oversight must be built into the harness itself — an architectural problem, not merely a procedural one.

The paper offers a unifying framework for researchers and engineers building agents: rather than asking “which LLM should I use,” the more fitting question is “how should I structure the harness so that code becomes a reliable medium between the model and the real world.”