DiffusionGemma, Gemma 4를 개조해 초당 1,500 토큰 달성했지만 추론은 뒤처져

google deepmind detailed diffusiongemma, a text diffusion model retrofitted from the existing gemma 4 checkpoint rather than trained from scratch. the conversion utilizes a two-phase process combining reinforcement learning and sampler distillation to balance quality with the massive speed gains of parallel denoising. this method allows the model to generate about 1,500 tokens per second on an h100 and improve at tasks requiring bidirectional context, like sudoku or structured json output. however, the report acknowledges that quality benchmarks fall short of the autoregressive base model, partly because the architecture was not originally designed for diffusion.