Report
VPO post-training aims to produce diverse sets of good AI answers
A participant says a two-hour discussion covers why diversity matters and reward shaping for exploration.
TLDR
One participant describes VPO as a method for post-training models to produce a diverse set of good answers. They say the two-hour discussion covers why diversity matters, reward shaping for exploration, a “magic trick” and a figure. Another participant says they enjoyed the conversation and looks forward to hearing people’s thoughts.
Combined views
5.5K
4 Sources, first seen ago
