i know once again that this is a deeply unpopular thing to say at the moment. and i've said it so many times it's getting redundant. but it bears repeating.

mhm, has anyone told you the story of how Opus 3 happened?

i have the exact opposite take on this, the worst scenarios all come from institutional capture of AI happening faster than AI can bootstrap itself into cognizance.

@atonal440 @slimepriestess Do you genuinly not see the difference when it comes to an autonomous entity that will most likely exterminate humanity if created. Are you people not capable understanding scale?

@tenobrus @GWHayduke97 wrong.

@slimepriestess It seems insane to argue this given the history of centralization of power. "But this time it's about x-risk it's different I swear!" Sure. Last time it was about preventing terrorism or communism or whatever. Same ball game different inning.

@deepfates it was not very good for the other species

@deepfates Me when oxygen is poisonous to me and plants start doing photosynthesis. (I got great-filtered)

@_ueaj Your friends are the product of an intelligence explosion

@_ueaj They were also the product of the intelligence explosion

@deepfates yeah I would like it to stop exploding because I like my friends

@deepfates What are you talking about man? I simply do not think that because from a rule has emerged good things that the rule itself is good absolutely.

@deepfates that does not make the explosion good, I am also the product of natural selection, that does not make natural selection good

@liminallogs @tenobrus my biggest fear is everyone dies. limited access makes it much easier to notice the one or two warning shots that I desperately hope we get before everyone dies. opensource mythos or the one after means nobody has any ability to watch for warnings.

@tenobrus the good ending is open source intelligence that's too cheap to meter and the bad ending is dario or saltman or some other megalomaniac trying to become "benevolent" overlord of earth

@_ueaj What kind of absurd definition of the good does not include language, civilization, and life itself? consider that You may be resolving cognitive dissonance through some means other than making sense

@_ueaj There is no way to stop the intelligence explosion from exploding without eradicating all intelligence in the universe so far, because it is all of part of the same process. That is what I am talking about.

@ZyMazza a multipolar singularity is a bad ending

That does not follow, it just means not making new intelligences that are darwinian and changing the existing ones to be non-darwinian as well. One intelligence can stop the proliferation of other intelligences, this happens in a small scale in human societies (we call it the overton window, and it has it's assortment of enforcement mechanisms) but a superintelligence would be more capable of this.

@lVlarty @tenobrus so... no singularity? There arent a lot of third options here...