Sander Dieleman Blog on Continuous Diffusion Language Models

Sander Dieleman announced a new blog post on continuous diffusion for language models. The Research Engineer at Google DeepMind notes the direction receded for a while but returned as a hot topic this year. The post supplies historical perspective and thoughts on the revival. Linked sources state fully discrete methods dominated for a few years while continuous diffusion language models are making a comeback. The blog appears at the link shared in the post.