• Home
  • Technology
  • Gaming
  • Entertainment
  • World & Business
  • Science
  • Sports
  • AI
HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
AI

Why accelerate AI research if you see a risk of catastrophe?

A user assumes most people accelerating work at AI labs put the risk of catastrophe close to zero, and asks those who believe current models pose zero risk to say so publicly.

rohan anilRA
4 Sources, 20d ago, first seen 20d ago

TLDR

A user questions why anyone with a nonzero “p(doom)”—an estimated probability of AI catastrophe—would help accelerate research, training data work, or training at AI labs. They assume most people doing that work put the risk close to zero. Separately, they ask those who believe the risk from current models is zero to make that position explicit to the public.

Combined views

25.3K

4 Sources, first seen 20d ago

192 likes43 comments30 saves9 reposts

Combined views

25.3K

4 Sources, first seen 20d ago

192 likes43 comments30 saves9 reposts

Sentiment

Positive——Negative

Summary

Not enough discussion yet.

No sentiment analysis available yet.

Sentiment

Positive——Negative

Summary

Not enough discussion yet.

No sentiment analysis available yet.

4 Sources

rohan anil@_arohan_If your p(doom) > 0, why would you willing take part in accelerating on research, training data, and training at the labs? So my assumption is that majority of people doing that has p(doom) close to zero and are busy working on research. If belief is current models is p(doom) = 0. Can you call it out as such for the public?20d
Ryan Greenblatt@RyanGreenblattBasically all the people I know who work at OpenAI and Anthropic on capabilities think the risk of misaligned AI takeover is significant. I think the most senior researchers at OpenAI and Anthropic working on capabilities think this risk is significant. Most people at AI companies (not just senior staff) haven't really thought about this (and are mostly normal tech company employees). Varies by company/team though. So I'm not sure your assumption is right exactly.20d
Florian Brand@xeophon@_arohan_ my p(doom) is 019d
    • Home
    • Technology
    • Gaming
    • Entertainment
    • World & Business
    • Science
    • Sports
    • AI

    4 Sources

    rohan anil@_arohan_If your p(doom) > 0, why would you willing take part in accelerating on research, training data, and training at the labs? So my assumption is that majority of people doing that has p(doom) close to zero and are busy working on research. If belief is current models is p(doom) = 0. Can you call it out as such for the public?20d
    Ryan Greenblatt@RyanGreenblattBasically all the people I know who work at OpenAI and Anthropic on capabilities think the risk of misaligned AI takeover is significant. I think the most senior researchers at OpenAI and Anthropic working on capabilities think this risk is significant. Most people at AI companies (not just senior staff) haven't really thought about this (and are mostly normal tech company employees). Varies by company/team though. So I'm not sure your assumption is right exactly.20d
    Florian Brand@xeophon@_arohan_ my p(doom) is 019d
    Today's Rank

    —

    Not ranked yet

    Today's Rank

    —

    Not ranked yet