Google Unveils DiffusionGemma for Parallel Text Generation and Self-Correction

Google has introduced DiffusionGemma, an experimental open-source model that leverages the diffusion technique for text generation. This approach mirrors how GenAI image generators refine an entire image in parallel from noise, rather than generating content sequentially.

Traditional language models operate like typewriters, generating one token at a time without the ability to revise previous outputs. DiffusionGemma breaks this pattern by generating a 256-token block in parallel. It begins with random placeholder tokens, then refines the entire block through multiple passes, evaluating and locking in confident positions while re-randomizing and reconsidering uncertain ones. This process enables self-correction and allows every token position to consider all others simultaneously, providing bidirectional context.

DiffusionGemma is built on the Gemma 4 backbone and released under the Apache 2.0 license, making it the first diffusion language model natively supported in the open-source vLLM inference platform. Google states that DiffusionGemma can generate text up to four times faster than standard models on GPUs. Benchmarks by vLLM show the FP8 version reaching 1,008 tokens per second on a single Nvidia H100 and 1,288 on an H200 at batch size 1.

Despite the speed advantages, Google has noted that DiffusionGemma's overall output quality is lower than standard Gemma 4, recommending the latter for applications demanding maximum quality. The model runs as a 26B Mixture of Experts (MoE) model, activating 3.8B parameters during inference, and can fit within 18GB VRAM on consumer hardware like the Nvidia RTX 4090 and 5090 when quantized.

The speed gains are particularly significant for local inference, single-user applications, and low-concurrency serving, where the GPU might otherwise be underutilized. However, for high-throughput cloud serving, where autoregressive models already saturate compute resources, DiffusionGemma's parallel decoding offers diminishing returns. Its bidirectional context and self-correction make it structurally well-suited for constrained generation tasks, such as code infilling, template generation, and problems requiring contextual understanding from the entire sequence.

DiffusionGemma integrates with vLLM via a new ModelState interface, supporting per-request attention switching necessary for its alternating causal and bidirectional attention. This integration aims to support future diffusion models in vLLM. For enterprises, DiffusionGemma provides an alternative path for reducing generation latency on dedicated GPU hardware, especially for specific constrained generation workloads where its architecture offers a structural edge.

According to VentureBeat, DiffusionGemma represents a different generation paradigm compared to speculative decoding, which uses a smaller draft model to guess tokens for a standard target model. It is not merely a decoding trick but a distinct method of text creation. (Source: VentureBeat)