• Home
    • Technology
    • Gaming
    • Entertainment
    • World & Business
    • Science
    • Sports
    • AI
    HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
    AI
    Report

    Anthropic gives a METR team employee-like access

    Anthropic says it is in discussions with multiple organizations about third-party evaluations of its safety practices.

    Andrew CurranAC
    2 Sources, 2h ago, first seen 2h ago

    TLDR

    Anthropic says it has committed to having evaluators assess its safety practices and has given a team from METR employee-like access. The company says it is in discussions with multiple organizations and has shared an explanation of how it works with third-party evaluators.

    Combined views

    25.7K

    2 Sources, first seen 2h ago

    958 likes43 comments151 saves45 reposts

    Combined views

    25.7K

    2 Sources, first seen 2h ago

    958 likes43 comments151 saves45 reposts
    Image: @AndrewCurran_ on X

    Sentiment

    Positive——Negative

    Summary

    Not enough discussion yet.

    No sentiment analysis available yet.

    Featured Source

    Sentiment

    Positive——Negative

    Summary

    Not enough discussion yet.

    No sentiment analysis available yet.

    2 Sources

    Andrew Curran@AndrewCurran_METR now has employee level access to Anthropic's frontier models. Also, this is exactly the type of blog post you make just before releasing a shockingly powerful and capable new model, I'm just saying.2h
    Rohan Paul@rohanpaul_aiAnthropic has placed 6 safety evaluators from the outside nonprofit METR inside the company, with access to internal systems, tools and staff roughly equal to that of its own risk teams. Six METR staff have company hardware, office space, and internal access “roughly on par” with Anthropic’s own risk assessment teams. METR will publish its own verdicts on how risky Anthropic’s models and practices are, and Anthropic cannot block them, only redact a few predefined categories such as customer data, a decision METR can publicly challenge. Other evaluators, such as SecureBio, start at the lowest of 3 new access tiers, where Anthropic still controls what they see and must approve what they publish.1h
    • Home
    • Technology
    • Gaming
    • Entertainment
    • World & Business
    • Science
    • Sports
    • AI

    2 Sources

    Andrew Curran@AndrewCurran_METR now has employee level access to Anthropic's frontier models. Also, this is exactly the type of blog post you make just before releasing a shockingly powerful and capable new model, I'm just saying.2h
    Rohan Paul@rohanpaul_aiAnthropic has placed 6 safety evaluators from the outside nonprofit METR inside the company, with access to internal systems, tools and staff roughly equal to that of its own risk teams. Six METR staff have company hardware, office space, and internal access “roughly on par” with Anthropic’s own risk assessment teams. METR will publish its own verdicts on how risky Anthropic’s models and practices are, and Anthropic cannot block them, only redact a few predefined categories such as customer data, a decision METR can publicly challenge. Other evaluators, such as SecureBio, start at the lowest of 3 new access tiers, where Anthropic still controls what they see and must approve what they publish.1h
    Today's Rank

    —

    Not ranked yet

    Today's Rank

    —

    Not ranked yet