SITUATION EXPLAINED: Government control of model releases is bad for everyone.
• Bad for accelerationists, obvious reasons
• Bad for safetyists too, iterated deployment
• Iterative deployment works because companies increase capabilities a little each time, people adapt, and companies learn from real world feedback how to make models more aligned
• Imagine if Google DeepMind had been a siloed government project for 10 years, no ChatGPT, no nothing, and then suddenly Fable drops
• People would lose their minds
• Worse: if all AI research happens inside a few government bunkers and something goes wrong with a rogue AI, there's far less civilizational defense
@theojaffee: "Imagine a world where we had nothing, and then we had superintelligence. That would be really bad."