Berton Shares Beyer Lecture Plot on SSL Limits
Ari Morcos replies that the SSL plot shows bad filtering, not a reason to skip it.
TLDR
Gabriele Berton posted about Lucas Beyer's lecture on vision models. He highlighted a plot where SSL plus a few labeled samples beat pure SSL, shifting his focus toward cheap labels. Ari Morcos replied that the result shows poor filtering rather than a reason to stop filtering. Morcos added that overfiltering removes useful data from many public datasets and stressed the need for curation that preserves non-English capabilities.
Berton Shares Beyer Lecture Plot on SSL Limits
Ari Morcos replies that the SSL plot shows bad filtering, not a reason to skip it.
