DiffusionGemma in vLLM: the first 26-billion-parameter discrete diffusion model integrated into a production inference framework
DiffusionGemma is a 26-billion-parameter model that, instead of classic left-to-right text generation, iteratively refines a 256-token canvas. Teams from vLLM, Google DeepMind, and NVIDIA achieved 1,288 tokens per second on an H200 GPU — roughly six times faster than autoregressive baseline models.