• Home
  • Technology
  • Gaming
  • Entertainment
  • World & Business
  • Science
  • Sports
  • AI
HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
  • HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
    • Home
    • Technology
    • Gaming
    • Entertainment
    • World & Business
    • Science
    • Sports
    • AI
    AI

    Anthropic pledges permanent system access for outside AI evaluators

    Dario Amodei says evaluators will get employee-level access to check safety compliance and assess model alignment during training. AVERI wants embedded auditing to become a binding industry requirement.

    MB
    AV
    2 Sources, ,

    TLDR

    Dario Amodei is calling for the AI industry to slow down, describing a three-part plan in his essay “We Must Pace the Frontier.” He says Anthropic is committing to the first step: permanent, employee-level access to its systems for third-party evaluators to verify adherence to safety measures, report incidents and assess models’ alignment during training.

    AVERI supports embedding independent experts within frontier AI companies and wants to move beyond voluntary auditing toward binding requirements. It says that requires standards for auditor qualifications and independence, audit methods and reporting, and the safety and security standards companies are audited against. AVERI says it is conducting pilot projects to help inform audit standards.

    Combined views

    13.8K

    2 Sources, first seen 18d ago

    Combined views

    13.8K

    2 Sources, first seen 18d ago

    106 likes
    18d ago
    first seen 18d ago
    106 likes
    21 saves
    19 reposts

    Sentiment

    Positive——Negative

    Summary

    Not enough discussion yet.

    No sentiment analysis available yet.

    21 saves
    19 reposts

    Sentiment

    Positive——Negative

    Summary

    Not enough discussion yet.

    No sentiment analysis available yet.

    Today's Rank

    —

    Not ranked yet

    Today's Rank

    —

    Not ranked yet

    2 Sources

    @AVERIorgAVERI commends recent statements by the leaders of Anthropic, OpenAI, and SpaceX regarding the importance of embedding independent experts within frontier AI companies. We are committed to working with various stakeholders to advance standards for frontier AI auditing, and moving towards binding requirements for auditing that aligns with those standards. Our flagship paper, “Frontier AI Auditing,” published in collaboration with experts in industry, civil society, and academia, lays out a vision for third-party auditing of frontier AI companies’ systems and practices and includes embedding as a key component. Embedding helps facilitate deep, secure access to non-public information. Moving embedded auditing from a voluntary practice to an effective and universal industry requirement requires not only pilot projects, but also standards, tooling, and thoughtful policy design. AVERI exists to provide these, and we are conducting pilot projects aimed at informing standards for different aspects of AI audits. Embedded auditing will require clear standards for who counts as a qualified and independent auditor, how audits should be conducted and reported, and what safety and security standards companies should be audited against. Fortunately, we are not starting from scratch: with evaluators across the ecosystem, we coauthored a standard (AEF-1) which covers, e.g., conflict of interest disclosure and management in an AI context. Learn more about vision for frontier AI auditing here: https://www.averi.org/ourwork/frontier-ai-auditing
    @Miles_BrundageRT @AVERIorg: AVERI commends recent statements by the leaders of Anthropic, OpenAI, and SpaceX regarding the importance of embedding indepe…

    2 Sources

    @AVERIorgAVERI commends recent statements by the leaders of Anthropic, OpenAI, and SpaceX regarding the importance of embedding independent experts within frontier AI companies. We are committed to working with various stakeholders to advance standards for frontier AI auditing, and moving towards binding requirements for auditing that aligns with those standards. Our flagship paper, “Frontier AI Auditing,” published in collaboration with experts in industry, civil society, and academia, lays out a vision for third-party auditing of frontier AI companies’ systems and practices and includes embedding as a key component. Embedding helps facilitate deep, secure access to non-public information. Moving embedded auditing from a voluntary practice to an effective and universal industry requirement requires not only pilot projects, but also standards, tooling, and thoughtful policy design. AVERI exists to provide these, and we are conducting pilot projects aimed at informing standards for different aspects of AI audits. Embedded auditing will require clear standards for who counts as a qualified and independent auditor, how audits should be conducted and reported, and what safety and security standards companies should be audited against. Fortunately, we are not starting from scratch: with evaluators across the ecosystem, we coauthored a standard (AEF-1) which covers, e.g., conflict of interest disclosure and management in an AI context. Learn more about vision for frontier AI auditing here: https://www.averi.org/ourwork/frontier-ai-auditing
    @Miles_BrundageRT @AVERIorg: AVERI commends recent statements by the leaders of Anthropic, OpenAI, and SpaceX regarding the importance of embedding indepe…