Reactions from ranked influencers
3 posts
US AI labs mad about China distilling their models
Of course as many commentators have pointed out, distilling a frontier model is not so different to pre-training on creative workers output. To the extent there's a line being crossed it would be evading account restrictions, similar to the difference between buying a book and scanning it vs pirating books, but as we've seen some US developers have been willing to do the latter... So I see a case for there being a double standard here, but I'd view the claim that distillation happened as being likely to be true.
@ARGleave That's fundamentally disanalogous, as torrenting books is a violation of US IP law whereas distilling a model against the wishes of the model developer isn't.