Reactions from ranked influencers
2 posts
For someone who is the "Head of Strategic Futures" at OAI, these are consistently naive & uninformed takes about open-source. For one, the history of Linux and its ubiquity in cyber/server-security suggests otherwise regarding such a risk of open-sourcing dual-use technology.
one interesting part of thinking about marginal risk of open-weight ai is that the internet is already such a profoundly crime-ridden place. imagine if gangs went into hospitals in America every week and stole people's medical records out of filing cabinets. if that happened in the physical world, we'd rightfully question whether government still possessed practical sovereignty. yet american hospitals are raided constantly in the digital world and we basically tolerate it. the world is more capable of absorbing risk and disorder than one might think.
Of course, there are many examples where open source decreases the risk of cybersecurity issues (for example, Linux), but you are right, I think the best thing is just to forbid all other models besides the OpenAI ones...
one interesting part of thinking about marginal risk of open-weight ai is that the internet is already such a profoundly crime-ridden place. imagine if gangs went into hospitals in America every week and stole people's medical records out of filing cabinets. if that happened in the physical world, we'd rightfully question whether government still possessed practical sovereignty. yet american hospitals are raided constantly in the digital world and we basically tolerate it. the world is more capable of absorbing risk and disorder than one might think.