Analysis Exposes Bias in Reward Guidance for Diffusion Models

It’s a bit of a different school of thought to reward guidance, but CFG itself may be able to replicate the more creation aspect of RL and does have tilting properties. Condition on the reward, CFG provides the extrapolation/maximization

https://www.ethansmith2000.com/post/classifier-free-guidance-and-reinforcement-learning