Paper asks: “Does On-Policy Distillation Really Distill?”
The paper frames its question around noisy teachers and self-improvement, with the subtitle “From Noisy Teacher to Self-Improvement.”
TLDR
A post shares “Does On-Policy Distillation Really Distill? From Noisy Teacher to Self-Improvement,” linking to the paper’s page on Hugging Face.
Combined views
16.2K
1 Source, first seen 29d ago
101 likes