DiffusionGemma、Gemma 4を改造して毎秒1,500トークンを実現するも推論性能は後れを取る

google deepmind detailed diffusiongemma, a text diffusion model retrofitted from the existing gemma 4 checkpoint rather than trained from scratch. the conversion utilizes a two-phase process combining reinforcement learning and sampler distillation to balance quality with the massive speed gains of parallel denoising. this method allows the model to generate about 1,500 tokens per second on an h100 and improve at tasks requiring bidirectional context, like sudoku or structured json output. however, the report acknowledges that quality benchmarks fall short of the autoregressive base model, partly because the architecture was not originally designed for diffusion.