• Home
  • Technology
  • Gaming
  • Entertainment
  • World & Business
  • Science
  • Sports
  • AI
HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
  • HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
    • Home
    • Technology
    • Gaming
    • Entertainment
    • World & Business
    • Science
    • Sports
    • AI
    AI

    Seán Ó hÉigeartaigh on Frontier Model Risks

    AI safety researcher posts on risks from unregulated frontier models.

    SÓ
    1 Source, 27d ago, first seen 27d ago

    TLDR

    Seán Ó hÉigeartaigh, an academic at the University of Cambridge who directs the AI:FAR programme, posted that absent regulation the risk from internal frontier models over the next 12 months will be set by which developer holds the most capable models and which is least aware of risks or employs practices such as risky RL environments. The post links to the Oxford Martin School paper on the unilateralist’s curse and a principle of conformity.

    Combined views

    885

    1 Source, first seen 27d ago

    Combined views

    885

    1 Source, first seen 27d ago

    22 likes
    22 likes
    1 comments
    6 saves
    3 reposts

    Sentiment

    Positive——Negative

    Summary

    Not enough discussion yet.

    No sentiment analysis available yet.

    1 comments
    6 saves
    3 reposts

    Sentiment

    Positive——Negative

    Summary

    Not enough discussion yet.

    No sentiment analysis available yet.

    Today's Rank

    —

    Not ranked yet

    Today's Rank

    —

    Not ranked yet

    1 Source

    @S_OhEigeartaighAbsent regulation, over the coming 12 months the risk the world faces from internal frontier models will be decided by a combination of (i) which developer has the most capable internal models and (ii) which developer is least aware of the risks from their models, or from practices such as the use of risky RL environments, or deems that risk lowest. OpenAI were plausibly the strongest on (i) this summer, but I do not believe they were the least aware or most risk-dismissing on (ii). And as they pause, and take steps to address the problems they've now seen, we may well see others shoot up to them. Absent regulation (or pretty robust industry and third party shared practices, standards and commitments, but this won't be enough for long) we will see worse problems, and my money would be on the problems not coming from OpenAI next time. (Which is not to say we shouldn't hold OpenAI to account this time). https://www.oxfordmartin.ox.ac.uk/publications/the-unilateralists-curse-the-case-for-a-principle-of-conformity

    1 Source

    @S_OhEigeartaighAbsent regulation, over the coming 12 months the risk the world faces from internal frontier models will be decided by a combination of (i) which developer has the most capable internal models and (ii) which developer is least aware of the risks from their models, or from practices such as the use of risky RL environments, or deems that risk lowest. OpenAI were plausibly the strongest on (i) this summer, but I do not believe they were the least aware or most risk-dismissing on (ii). And as they pause, and take steps to address the problems they've now seen, we may well see others shoot up to them. Absent regulation (or pretty robust industry and third party shared practices, standards and commitments, but this won't be enough for long) we will see worse problems, and my money would be on the problems not coming from OpenAI next time. (Which is not to say we shouldn't hold OpenAI to account this time). https://www.oxfordmartin.ox.ac.uk/publications/the-unilateralists-curse-the-case-for-a-principle-of-conformity