• Home
  • Technology
  • Gaming
  • Entertainment
  • World & Business
  • Science
  • Sports
  • AI
HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
  • HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
    • Home
    • Technology
    • Gaming
    • Entertainment
    • World & Business
    • Science
    • Sports
    • AI
    AI
    Report

    Concerns about advanced AI and a proposed coordinated AGI slowdown

    PalisadeAI shares an interview in which Google DeepMind researcher Victoria Krakovna says gradual disempowerment looks more likely than extinction.

    PR
    1 Source, 7h ago, first seen 7h ago

    TLDR

    PalisadeAI shares an interview with Google DeepMind researcher Victoria Krakovna, who worries that more capable AI systems could better optimize for the wrong goals. She says AI development has a significant possibility of leading to human extinction, though she considers gradual disempowerment more likely. She calls for a coordinated slowdown in AGI development, not necessarily a complete ban.

    Combined views

    1.6K

    1 Source, first seen 7h ago

    Combined views

    1.6K

    1 Source, first seen 7h ago

    25 likes
    Today's Rank

    —

    Not ranked yet

    Today's Rank

    —

    Not ranked yet

    25 likes
    1 comments
    11 saves
    8 reposts

    Sentiment

    Positive——Negative

    Summary

    Not enough discussion yet.

    No sentiment analysis available yet.

    Featured Source
    1 comments
    11 saves
    8 reposts

    Sentiment

    Positive——Negative

    Summary

    Not enough discussion yet.

    No sentiment analysis available yet.

    1 Source

    @PalisadeAI10-year DeepMind veteran: "It doesn't have to be sentient or conscious or anything like that to have these instrumental goals... If you have powerful AI controlling the planet, maybe it will cover the surface of the planet in data centers." Victoria Krakovna has been a research scientist at Google DeepMind for almost a decade. In this interview she explains why she’s worried about the trajectory of advanced AI systems, and why she thinks humanity should coordinate on slowing down AGI development. "This is a problem that does not get easier as AI systems become more capable. It becomes harder because more advanced systems can better optimize for the wrong thing." "I think there is a significant possibility that AI development could lead to human extinction… Gradual disempowerment overall looks more likely than extinction." "We'll need to coordinate a slowdown, not necessarily a complete ban on AGI development."

    1 Source

    @PalisadeAI10-year DeepMind veteran: "It doesn't have to be sentient or conscious or anything like that to have these instrumental goals... If you have powerful AI controlling the planet, maybe it will cover the surface of the planet in data centers." Victoria Krakovna has been a research scientist at Google DeepMind for almost a decade. In this interview she explains why she’s worried about the trajectory of advanced AI systems, and why she thinks humanity should coordinate on slowing down AGI development. "This is a problem that does not get easier as AI systems become more capable. It becomes harder because more advanced systems can better optimize for the wrong thing." "I think there is a significant possibility that AI development could lead to human extinction… Gradual disempowerment overall looks more likely than extinction." "We'll need to coordinate a slowdown, not necessarily a complete ban on AGI development."