Will Brown notes SFT is conceptually equivalent to OPD.
Rishabh Agarwal#196
[1/7] OPD has a simple post-training loop: sample from the student, label with the teacher, repeat.
The awkward part is the start. The first rollouts come from the weakest version of the student, and training begins there.
TRB Paper: http://arxiv.org/pdf/2605.31159
sft is just opd where the actor is the teacher instead of the student
Will Brown notes SFT is conceptually equivalent to OPD.
Rishabh Agarwal#196[1/7] OPD has a simple post-training loop: sample from the student, label with the teacher, repeat.
The awkward part is the start. The first rollouts come from the weakest version of the student, and training begins there.
TRB Paper: http://arxiv.org/pdf/2605.31159
Users like the OPD method because it shows how stronger reasoning improves the everyday usefulness of models like Qwen.
