Block Diffusion restores efficient caching for diffusion language models, a post says

Diffusion language models generate multiple tokens—pieces of text—in parallel, a post explains. But iterative unmasking repeatedly updates token states, limiting reuse of the key-value (KV) cache. The post says Block Diffusion restores efficient caching by decoding blocks from left to right while generating each block in parallel.