Report
Simplex Diffusion Models announced with a critique of discrete diffusion
The announcement claims standard discrete diffusion models suffer “information collapse” because sampling categorical tokens discards uncertainty at intermediate steps.
TLDR
The Simplex Diffusion Models announcement argues that standard discrete diffusion models lose uncertainty when they sample categorical tokens at intermediate steps, a problem it calls “information collapse.”
Combined views
30.8K
6 Sources, first seen 4h ago
428 likes
