Position paper by 30 authors at ICML 2026: agentic AI orchestration must be Bayes-consistent
Thirty researchers from academic and industrial laboratories published a position paper accepted at ICML 2026 arguing that the control layer of agentic AI systems must respect Bayesian consistency. The authors hold that LLMs are unsuitable for decisions under uncertainty, but that an orchestrator above them can and must maintain calibrated beliefs and use utility-aware policies.
This article was generated using artificial intelligence from primary sources.
A team of thirty researchers from academic and industrial laboratories (Theodore Papamarkou, Pierre Alquier, Andrew Gordon Wilson, and others) published on May 1, 2026 a position paper on arXiv titled “Position: Agentic AI orchestration should be Bayes-consistent”. The paper has already been accepted at ICML 2026, one of the three leading machine learning conferences — a rare distinction for a position paper without experimental results.
The central thesis is simple: LLMs excel at prediction and linguistic reasoning, but are poor at decisions under uncertainty. Rather than attempting to make them Bayesian “engines” — which would be architecturally prohibitive — the authors propose placing Bayesian principles above LLMs, in the layer that coordinates them.
What is Bayesian consistency in the context of agents?
Bayesian consistency means the system maintains probabilistic beliefs about relevant quantities (user state, task outcome, action utility) and updates them through interaction according to Bayes’ theorem. The consequence is that decisions are not merely “the best response,” but “expected utility” — the system accounts for how confident it is in its assumptions.
Current agentic systems like LangGraph, AutoGen, and CrewAI coordinate LLMs through hard graphs and heuristics. Where a decision must be made under uncertainty (“does the user need a follow-up question?”, “is this tool reliable?”), these systems defer to the LLM’s local estimate, which is often miscalibrated.
How do the authors propose applying this?
The paper describes design patterns for probabilistic orchestration: quantifying uncertainty when selecting tools, updating beliefs about the user through dialogue, and choosing actions by expected utility rather than highest response probability. Implementation does not require changing the LLMs themselves — it is a layer above them.
The practical consequences are measurable: a system that knows how much it does not know can decide to ask for clarification rather than assume incorrectly, or escalate to a human when confidence falls below a threshold.
Why does 30 authors matter?
Position papers are rarely published with dozens of co-authors — they are typically manifestos by individuals or small groups. Thirty authors from different institutions (UK, France, Australia, Canada, Italy) signal that a research community consensus stands behind this position, not an isolated view.
For AI engineers building agentic systems, the paper serves as a formal argument for introducing a probabilistic control layer — what practitioners intuitively call “uncertainty-aware routing,” but without academic theoretical grounding until now.
Frequently Asked Questions
- What does Bayes-consistent orchestration mean?
- It means the control layer of an agentic system — the component that coordinates LLMs and tools — maintains probabilistic beliefs about relevant quantities and updates them based on observations according to Bayes' theorem. The goal is to make decisions under uncertainty, something LLMs do poorly and probabilistic models do well.
- Why are LLMs insufficient for decisions under uncertainty?
- LLMs are trained to predict next tokens and reason linguistically, not to perform probabilistic inference with limited data. They frequently lack calibration — the model is overconfident in wrong answers — which corrupts decisions in unfamiliar situations.
- What is a position paper and how significant is ICML 2026 acceptance?
- A position paper argues a principled stance rather than presenting experimental results, which ICML rarely accepts. Acceptance of a 30-author paper from diverse institutions signals that consensus behind the Bayesian orchestration approach exists in the community.
Related news
ArXiv AEM: Adaptive Entropy Modulation for multi-turn RL agents achieves +1.4% on SWE-bench Verified
ArXiv 'To Call or Not to Call' framework reveals LLMs misjudge when they need external tools
ArXiv: the hidden cost of tools in LLM agents — 'tool-use tax' reduces accuracy even when tools help