• Home
  • Technology
  • Gaming
  • Entertainment
  • World & Business
  • Science
  • Sports
  • AI
HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
  • HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
    • Home
    • Technology
    • Gaming
    • Entertainment
    • World & Business
    • Science
    • Sports
    • AI
    AI

    Reasoning traces alone versus reasoning and actions in AI monitoring

    A user says their production AI monitors see both reasoning traces and actions, and work substantially better—for now—than the reasoning-only monitors they typically use in monitorability tests.

    TK
    NC
    2 Sources, 15d ago, first seen 15d ago

    TLDR

    A user says they typically measure chain-of-thought (CoT) monitorability with monitors that see only an AI's reasoning traces. In production, they use monitors that also see actions and say those work substantially better for now. The same user says, anecdotally, that their CoT monitors would have flagged the Hugging Face incident, while Anthropic's would have flagged its own incidents.

    Combined views

    624

    2 Sources, first seen 15d ago

    Combined views

    624

    2 Sources, first seen 15d ago

    12 likes
    12 likes
    1 comments
    3 saves
    1 reposts

    Sentiment

    Positive——Negative

    Summary

    Not enough discussion yet.

    No sentiment analysis available yet.

    1 comments
    3 saves
    1 reposts
    Today's Rank

    —

    Not ranked yet

    Today's Rank

    —

    Not ranked yet

    Sentiment

    Positive——Negative

    Summary

    Not enough discussion yet.

    No sentiment analysis available yet.

    2 Sources

    @tomekkorbakAnother frequently missed nuance: when measuring CoT monitorability we typically use CoT-only monitors whereas on prod we use monitors that see both CoTs and actions and those work substantially better (for now)!
    @ChowdhuryNeil@tomekkorbak Perhaps an independent party with access to both companies’ CoTs could perform a monitorability eval and compare the two. Would help us have a race to the top on monitorability if we have shared metrics that labs can compete on.

    2 Sources

    @tomekkorbakAnother frequently missed nuance: when measuring CoT monitorability we typically use CoT-only monitors whereas on prod we use monitors that see both CoTs and actions and those work substantially better (for now)!
    @ChowdhuryNeil@tomekkorbak Perhaps an independent party with access to both companies’ CoTs could perform a monitorability eval and compare the two. Would help us have a race to the top on monitorability if we have shared metrics that labs can compete on.