• Home
  • Technology
  • Gaming
  • Entertainment
  • World & Business
  • Science
  • Sports
  • AI
HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
  • HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
    • Home
    • Technology
    • Gaming
    • Entertainment
    • World & Business
    • Science
    • Sports
    • AI
    AI

    LessWrong Post Flags Gaps in OpenAI Monitorability Evals

    Sarah Wiegreffe shares a LessWrong post examining limits in chain-of-thought monitoring tests.

    CP
    SW
    2 Sources, 40d ago, first seen 40d ago

    TLDR

    Sarah Wiegreffe posted a LessWrong analysis titled Evaluating Chain-of-Thought Monitorability is Still an Open Problem. The piece comments on OpenAI's monitorability evaluations and argues that current methods for testing chain-of-thought oversight leave key questions unresolved. Christopher Potts called the work timely and valuable. The post draws on feedback from Iván Arcuschin Moreno and focuses on research problems that remain open rather than settled findings.

    Combined views

    7.6K

    2 Sources, first seen 40d ago

    Combined views

    7.6K

    2 Sources, first seen 40d ago

    80 likes
    Today's Rank

    —

    Not ranked yet

    Today's Rank

    —

    Not ranked yet

    80 likes
    1 comments
    46 saves
    4 reposts

    Sentiment

    Positive——Negative

    Summary

    Not enough discussion yet.

    No sentiment analysis available yet.

    1 comments
    46 saves
    4 reposts

    Sentiment

    Positive——Negative

    Summary

    Not enough discussion yet.

    No sentiment analysis available yet.

    2 Sources

    @sarahwiegreffeWondering about the current state of CoT monitorability evaluation (a sticky research problem)? Check our our recent blogpost, where we break this down in detail 👇 https://www.lesswrong.com/posts/z9fPtghFxELBXebY3/evaluating-chain-of-thought-monitorability-is-still-an-open
    @ChrisGPottsWhat a timely and valuable contribution – thank you!

    2 Sources

    @sarahwiegreffeWondering about the current state of CoT monitorability evaluation (a sticky research problem)? Check our our recent blogpost, where we break this down in detail 👇 https://www.lesswrong.com/posts/z9fPtghFxELBXebY3/evaluating-chain-of-thought-monitorability-is-still-an-open
    @ChrisGPottsWhat a timely and valuable contribution – thank you!