Reactions from ranked influencers
6 posts
If I distill from a model that distilled from a model that distilled from another model, what’s going to happen? Nothing. You cannot prevent any of this. It’s also BS to try when the original model trained on metric tons of copyright data it will never be taken to court for. It’s a waste of time to regulate the inevitable. The real solution is to heavily invest in American companies securing open weight models for our citizens and national security.
My goal isn’t to debate right or wrong. It’s to encourage you folks on the other side that this is futile. To ensure our future, invest in what we can control, not what we cannot. Invest in security and accept what is going to happen anyway. You cannot stop the global Internet. In the short term: this is pure reg capture by Anthropic which is much worse. In the very long term, we increase competition and begin the journey to making things safe.
@Suhail yeah
What are you going to do when the Japanese distill Kimi, Europe distills the Japanese model, and then Brazil distills Europe and India’s models for different capabilities? Then a teenager in America makes that model a little better and calls it USA-1 and it’s also free? Is Anthropic going to take Bobby FineTuner to court?
Important Qs for anyone considering bans on "Chinese open source AI": - How do you define "distillation" and what contortions are required to apply this to Chinese cos but not practices by US cos? Does RLAIF count? - If a US co distills a new OS model from a chinese model, can that be used? Is there a "fruit of the poisonous tree" concept? If not, this whole exercise is kind of futile.
If I distill from a model that distilled from a model that distilled from another model, what’s going to happen? Nothing. You cannot prevent any of this. It’s also BS to try when the original model trained on metric tons of copyright data it will never be taken to court for. It’s a waste of time to regulate the inevitable. The real solution is to heavily invest in American companies securing open weight models for our citizens and national security.
@parkerconrad Also couldn’t we just use it with our European entity?