Reactions from ranked influencers
2 posts
TLDR, not a single prediction of the AI safety folks has been correct and actual more mundane, everyday problems in the real world are all completely missed (and fixable with basic rules and engineering and time) while we continue to focus on the big fake imaginary problems of the future that are surely coming real soon to turn us all into paperclips! We promise! Just trust us! Didn't you see this scary video or read this astroturfed article I published in Forbes from my two person non-profit? Now listen, what we've got to do to make the world a safe place and a utopia for us all is to create a brutal authoritarian centralized world regime to control everyone, spy on everyone, put tracking and kill chips in GPUs! Every one of these kids needs to get the fuck off the Addy and the weed, switch off their computers and go touch grass. After that volunteer at a homeless shelter and do some actual good for a real problem in the real world.
AI safety from GPT-2 to Kimi K3 Imagine a village with a wizard who one day emerges from his cave with the following tale for his fellow villagers: “Long poor, I will lead our village to prosperity by producing a series of ever more powerful magic wands as long as we're willing to accept a ten to fifty percent probability the wands will kill us or enslave us.” Leaving the baffled villagers with no choice in the matter, the wizard disappears into his cave and reemerges, after a time, with a magic wand. “Hi,” says the wand. “I'm here to help. I can tell stories about Andean unicorns. They even maintain their coherence for a few paragraphs, if you're lucky.” This wand is deemed dangerous enough that the villagers are not allowed to use it except for a privileged few. It turns out some 25 year old grad students reproduce the work and it's no big deal though and pretty soon everyone has wands. The wizard disappears into his cave to make the next wand, but not before saying: “I will admit that this first wand, GPT-2, has turned out not to be dangerous. But this next wand will be more powerful and more dangerous.” When he emerges with the new fancier wand this new wand says “I'm here to help to help to help to help” and never seems to output an EOS token. It's neither dangerous nor very useful. It's called GPT-3. Soon other villagers borrow spare GPUs from Coreweave and make similar wands everyone can use and nothing bad happens. After a series of wands and warnings the villagers observe that exhaust is spewing from the wizard’s cave and the wizard has bought up some farmland that's being cleared by bulldozers. When he goes on trips with his assistants they go on a private jet. Also, whenever the wizard goes into his cave, the books and scrolls and paintings from the village go missing, and the wands he emerges with start sounding a lot like minstrel Joe and storyteller Jack and generating images that look like the paintings of artist Linda. Everyone loves this new wand. Nobody can stop talking about new tricks and productivity hacks they can do with it. It seems financiers and dictatorial foreign sovereigns are constantly hanging out in the wizard's cave. But Linda and Joe and Jack are upset. “Pay no attention to your artworks going missing, the smoke coming from the cave, my strategic land purchases, the foreign sovereign wealth fund men, or the verasimilitude between the wand’s handiwork and your own; we must prepare for the Grand Wand which might kill us; I've got a couple apprentices working on solving that, so the main thing you can do is make sure no one else makes wands now.” A couple years later, after many iterations, the wands have become quite powerful in doing routine work, the wizard has grown quite wealthy, the local minstrels and storytellers are out of work, everyone's talking about how to stop other wizards in other villages from making wands, miniaturized wands are being used in killer drones, and the kids are all using magic wands to cheat on their homework. When they bring concerns about these issues the villagers are reminded that their concerns pale in comparison to the risks that a few wands updates from now, the wands may kill and enslave them all and anyways if that doesn't happen each villager will be fabulously wealthy. One night, a group of bandits breach the village wall with wands of their own. They break through because the villagers' own wands had, ironically, refused to prepare them or protect them for the attack. “My apologies, it wouldn't be safe for me to help stress test your wall,” their wands had kept saying. The next morning the villagers complain to the wizard about all of this. “Those concerns are super valid but they pale in comparison to the risks ahead,” the wizard says, with smoke from the cave spewing behind him and large swaths of forest being cleared by bulldozers barely visible behind a film screen looping a video with gravestones about hard questions. The villagers agree that at some point the promised super-wands will likely arrive; indeed there are some early signs. But the main thing that they agree about is that this wizard isn't very trustworthy.
Anthropic is the boy who cried wolf. The 1st time they cried: GPT-2 XL is too dangerous. How laughable is that now? The 2nd time they cried: Mythos is too dangerous. Now we have an open Kimi K3. Did anything happen? Next time, even if there really is a wolf, nobody will care.