arXiv:2606.08048: PoE-Bridge speeds up diffusion language models 5× with parallel decoding

arXiv published a paper on 6 June 2026 (label arXiv:2606.08048, version v1) that introduces PoE-Bridge, a decoding framework for substantially faster text generation. The method combines two families of language models in order to use the speed of one and the quality of the other.

Which problem does PoE-Bridge solve?

Diffusion language models (DLM) promise fast, parallel generation, but their quality often lags behind autoregressive models (AR), which produce tokens one by one and achieve top accuracy. The development challenge is to combine the speed of the former with the quality of the latter.

PoE-Bridge bridges exactly that gap. Instead of choosing between a fast and a high-quality approach, the framework combines them so that the result keeps most of the autoregressive model’s quality while gaining substantially in speed.

How does the Product-of-Experts distribution work?

The core of the method is bridging diffusion and autoregressive models through a Product-of-Experts intermediate distribution. Product-of-Experts is a technique in which the outputs of several models are combined by multiplying probabilities, keeping only the proposals that are convincing for all participants.

In PoE-Bridge this intermediate distribution links the diffusion and autoregressive models so that the diffusion part offers fast, parallel proposals, while the autoregressive part ensures the final output stays high-quality.

How does parallel decoding proceed?

The method performs parallel drafting (proposing several tokens at once) with rejection sampling, followed by an importance-sampling correction. In this order, a set of candidates is first generated quickly, then those that do not match the target distribution are rejected, and finally the remaining results are statistically corrected.

This procedure allows several tokens to be processed at once instead of strictly in sequence. It thereby achieves the speedup characteristic of diffusion models, but without abandoning the quality that autoregressive generation provides.

How much faster and more accurate is the method?

According to the paper, PoE-Bridge achieves a 5× speedup over standard DLM decoding. In doing so it recovers at least 95% of the target autoregressive model’s performance, which means the large gain in speed is accompanied by only a small loss in quality.

That ratio makes the method attractive for applications where both throughput and accuracy matter. Users get faster responses without having to significantly sacrifice the reliability of the results.

On which tasks does PoE-Bridge stand out?

The paper reports substantial progress on math reasoning and coding tasks. These are domains where even small shifts in the token sequence can ruin the final result, so preserving 95% of performance is especially valuable.

That is exactly why the result is interesting for developing models aimed at complex reasoning. PoE-Bridge shows that the diffusion approach can be used even in demanding, precision-sensitive tasks, and not only in simple text generation.