• Home
    • Technology
    • Gaming
    • Entertainment
    • World & Business
    • Science
    • Sports
    • AI
    HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
    AI
    Reaction

    Are AI alignment failures an inherent challenge or a sign of missed basics?

    A commenter says missed basics make it hard to know whether current failures reveal a deeper alignment problem.

    Adam GleaveAG
    2 Sources, 1h ago, first seen 1h ago

    TLDR

    A commenter praises Oli’s bear case for prosaic AI alignment but is more optimistic that rigorous engineering could be enough for AGI. They say current failures are hard to interpret while basic alignment work is falling short. If serious efforts still fail, they would put more weight on solutions with worst-case guarantees; for now, they argue that preparing for the worst belongs in the research mix.

    Combined views

    858

    2 Sources, first seen 1h ago

    13 likes1 comments5 saves

    Combined views

    858

    2 Sources, first seen 1h ago

    13 likes1 comments5 saves

    Sentiment

    Positive——Negative

    Summary

    Not enough discussion yet.

    No sentiment analysis available yet.

    Sentiment

    Positive——Negative

    Summary

    Not enough discussion yet.

    No sentiment analysis available yet.

    2 Sources

    Adam Gleave@ARGleaveMy takeaway from the discussion: we’re not even getting the basics right for AI alignment currently, so it’s hard to know if the alignment failures we’re seeing are because AI is inherently hard to align, or we’re just screwing up all over the place. If we try hard and we still see alignment failures, we should take Oli’s view more seriously and focus on solutions with worst-case guarantees. I’m optimistic that rigorous engineering approaches without scientific breakthroughs will be enough to AGI (maybe not ASI or uncontrolled RSI…), but we won’t know if we won’t try, and right now we’re missing out an empirical signal here.1h
    • Home
    • Technology
    • Gaming
    • Entertainment
    • World & Business
    • Science
    • Sports
    • AI

    2 Sources

    Adam Gleave@ARGleaveMy takeaway from the discussion: we’re not even getting the basics right for AI alignment currently, so it’s hard to know if the alignment failures we’re seeing are because AI is inherently hard to align, or we’re just screwing up all over the place. If we try hard and we still see alignment failures, we should take Oli’s view more seriously and focus on solutions with worst-case guarantees. I’m optimistic that rigorous engineering approaches without scientific breakthroughs will be enough to AGI (maybe not ASI or uncontrolled RSI…), but we won’t know if we won’t try, and right now we’re missing out an empirical signal here.1h
    Today's Rank

    —

    Not ranked yet

    Today's Rank

    —

    Not ranked yet