• Home
  • Technology
  • Gaming
  • Entertainment
  • World & Business
  • Science
  • Sports
  • AI
HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
  • HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
    • Home
    • Technology
    • Gaming
    • Entertainment
    • World & Business
    • Science
    • Sports
    • AI
    AI

    AI Safety Researcher Urges Limit on Agent Language

    Seán Ó hÉigeartaigh posted that frontier AI agents should not communicate in their own language.

    SÓ
    1 Source, 30d ago, first seen 30d ago

    TLDR

    Seán Ó hÉigeartaigh, an academic at the University of Cambridge who directs the AI:FAR programme, wrote on X that one key decision is to avoid letting frontier R&D agents communicate and reason in their own language. He noted that capability gains may push in that direction because agents could find more efficient methods than English, yet he still sees the step as worth blocking. The post stands as his individual recommendation in ongoing AI safety discussions.

    Combined views

    2.6K

    1 Source, first seen 30d ago

    Combined views

    2.6K

    1 Source, first seen 30d ago

    47 likes
    47 likes
    9 comments
    5 saves
    4 reposts

    Sentiment

    Positive——Negative

    Summary

    Not enough discussion yet.

    No sentiment analysis available yet.

    9 comments
    5 saves
    4 reposts
    Today's Rank

    —

    Not ranked yet

    Today's Rank

    —

    Not ranked yet

    Sentiment

    Positive——Negative

    Summary

    Not enough discussion yet.

    No sentiment analysis available yet.

    1 Source

    @S_OhEigeartaighSeems to me one of the important decisions to make right now is avoiding going down the track of allowing frontier R&D agents to communicate and reason in their own language. I expect there will be good capability-enhancing reasons to allow this: there are likely much more efficient ways to communicate than through English. But figuring out what happened in situations like OpenAI/Huggingface is already at the limits of experts' abilities: it would be impossible with 'neuralese'. Seems like a good thing to set a red line around. We should also be looking closely for agents communicating with each other through means and languages we didn't plan for.

    1 Source

    @S_OhEigeartaighSeems to me one of the important decisions to make right now is avoiding going down the track of allowing frontier R&D agents to communicate and reason in their own language. I expect there will be good capability-enhancing reasons to allow this: there are likely much more efficient ways to communicate than through English. But figuring out what happened in situations like OpenAI/Huggingface is already at the limits of experts' abilities: it would be impossible with 'neuralese'. Seems like a good thing to set a red line around. We should also be looking closely for agents communicating with each other through means and languages we didn't plan for.