Will Brown, Prime Intellect research lead, proposes Multi-model On-Policy Distillation to scale reinforcement learning steps

i’ve come around to understanding that the golden path application of OPD is MOPD to enable parallelization of exploration as well as to extend the effective number of RL steps you can juice out of any given async recipe

branch-train-merge for on-policy learning