Paper Introduces Diffusion-Augmented LLMs

Tanishq Mathew Abraham posted about research defining an autoregressive distribution and applying diffusion to sample multiple tokens in parallel. The work presents an 8B Uno model said to outperform the 26B DiffusionGemma. Accompanying materials include the arXiv preprint, a GitHub repository under ifm-ai/uno, a Hugging Face collection named uno, and a project page at s-sahoo.com/uno. The post contains an attached image of the paper.