Latent Space Prediction Yields Exponential Gains in Generative Model Efficiency

Why are generative models so data-hungry? Maybe because we ask them to predict raw tokens/pixels when predicting in latent space can yield an exponential gain in sample complexity! Proud of our new work with @alesfav and @MatthieuWyart 🧵