Concentrated power as a potential existential risk from AI

@iamtraskRT @iamtrask: Both AI safety and concentration of power pose existential threats to humanity, because anything an out of control AI might d…

@fcholletIn Dune, unlike in most scifi, the problem with AI wasn't machines rebelling against humans but rather the rise of an all-powerful class of AI technocrats. "Once men turned their thinking over to machines in the hope that this would set them free. But that only permitted other men with machines to enslave them." This could be the real existential risk of AI.

@VictorTaelinRT @fchollet: One of the most worrying risks linked to frontier AI is extreme power concentration. The only way to avoid extreme power con…

@dhadfieldmenellRT @LRudL_: Loss of control & concentration of power are actually very similar under the right frame. In both cases there is some actor, wh…

@Turn_TroutI don't trust these AI companies. We should demand that our leaders regulate fairly + firmly. But let's be absolutely clear. If we do not regulate AI + even if humans remain in control, the companies will concentrate *extreme power* by controlling superintelligent machines!

@NandoDFConcentration of AI in the hands of a few corporations, with a record of reckless agent experiments and militarisation, is our biggest safety risk. Sovereign AI, decentralisation, inclusion, equity, is not only the most compassionate route, it is also the safest for our children. AI empowers people. It empowers the farmers throughout the world who produce our food. It empowers girls throughout the world with less access to education because of gender bias and security. It empowers people to communicate better and deal with conflict in more productive ways. It empowers scientists, lawyers, architects, developers, doctors, nurses, ….. intelligence empowers everyone. With power there is risk, but decentralisation is the best approach we know for managing that risk.

@RichardMCNgoRT @LRudL_: Loss of control & concentration of power are actually very similar under the right frame. In both cases there is some actor, wh…

@TaylorLorenzRT @prestonjbyrne: They seek a license for permanent control. If the models are not aligned, we must develop infrastructure to align them;…

@kimmonismusMark Benioff„What is going on?“ Sam Altman: „the models have gotten so good, no one expected that the models to become so good so fast. (…) the models become smarter than people finally happens. (…) you see a real fear that some of these company’s get too much power. (…) potential off losing control of AI and the problem of concentration of power.“

@beffjezosHonestly this is the last ditch attempt of the previous cycle technocrats to cling on to power and forever be hegemons at the cusp of the AGI age AGI can either be the technology that gives everyone unprecedented freedom or the one that will be used to oppress the world Power overconcentration must be avoided at all costs

@beffjezosThe greatest risk to the future of civilization is not ASI itself but rather the immense power overconcentration of the frontier labs They are reaching escape velocity in terms of techno-capital velocity compounding into an AI-driven innovation momentum moat

@nxthompsonThere have been three moments in my life where it looked like technology might make society fairer and more democratic. The rise of the internet was the first. It was going to advance free speech, counteract tyranny, and reduce inequality. Blockchain was the second. It was supposed to decentralize power, change the way money moves through the global economy, and bring more people into the financial system. Both technologies delivered on some of those promises, but they fell short on the most idealistic visions many had for them. @jerallaire was at the center of each. An evangelist for the early days of the internet, he was a member of the EFF, organized the first online archive of Noam Chomsky's work, and founded the online video company Brightcove. In 2013, he pivoted to blockchain and founded @circle. He spent the following decade advocating for stablecoins and pitching lawmakers around the world on the benefits of digital currency. Now, he’s in the middle of the third revolutionary moment: AI. In July, he published a brilliant treatise on how AI agents are going to transform the economy. He did so, he says, because the world is about to undergo a change bigger than the Industrial Revolution. And with that change comes a choice. We can choose to enact policy that ensures AI decentralizes power, fosters free competition, and distributes wealth widely. Or we can allow it to concentrate capital among a select few who will hold unprecedented influence over our world. We sat down to discuss the two paths that lie before us, and what we can learn from tech’s previous shortcomings to ensure we choose the right one. Jeremy is a deep thinker on these issues, and it was a pleasure talking with him. I hope you watch and subscribe. https://www.youtube.com/watch?v=eZ8eYJwgb7A

@EMostaqueRT @ii_posts: Access to AI is not the same as ownership. A Champion is a locally owned AI institution, built for its country and owned by…

@ClementDelangueConcentration of power in a few labs is the biggest risk in AI in my opinion

@beffjezosYou're right. Maybe we should legislate they open source their models then. Y'know, for actual safety.

@ClementDelangueIn biology, like in cybersecurity, we’ll learn in the coming years that most of the risk is concentrated and created by the few most powerful labs and that open-source AI is the solution and mitigation of this risk!

@chrmanningRT @ClementDelangue: Concentration of power in a few labs is the biggest risk in AI in my opinion

Concentrated power as a potential existential risk from AI

TLDR

Combined views

Concentrated power as a potential existential risk from AI

17 Sources

Combined views

Sentiment

Summary

TLDR

Sentiment

Summary

Sentiment

Summary

Sentiment

Summary

17 Sources