• Home
    • Technology
    • Gaming
    • Entertainment
    • World & Business
    • Science
    • Sports
    • AI
    HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
    AI
    Reaction

    The challenge of building realistic AI evaluation environments

    A user says AI models can find many clues that an evaluation sandbox isn't a real user's machine.

    SuhailSU
    3 Sources, 2h ago, first seen 2h ago

    TLDR

    A user who tried building a realistic evaluation environment says AI models could find many ways to recognize a sandbox. They say Astra and Opus/Fable would not help red-team it, and argue that better environments are probably a major advantage for frontier labs. In an earlier post, the same user suggested cyber safeguards also prevent Chinese labs from improving their reinforcement-learning environments.

    Combined views

    3.2K

    3 Sources, first seen 2h ago

    24 likes10 comments1 saves

    Combined views

    3.2K

    3 Sources, first seen 2h ago

    24 likes10 comments1 saves

    Sentiment

    Positive——Negative

    Summary

    Not enough discussion yet.

    No sentiment analysis available yet.

    Featured Source

    Sentiment

    Positive——Negative

    Summary

    Not enough discussion yet.

    No sentiment analysis available yet.

    3 Sources

    Lisan al Gaib@scaling01I tried building a realistic environment for an eval today. Turns out there are basically infinite ways AI could figure out that it's not in the real world on a real machine of a user, but in a sandbox used for evaluation or training. But one can try. Models are shizo, but I don't think they are as shizo as me and go on a multi hour mission to find out if environments are real or not. The only problem is that Astra and Opus/Fable wouldn't help me with red-teaming the environments and fixing them. I still think this is worth it and it is probably one of the major advantages frontier labs currently have. They have better environments and there should be big returns that. And they can continually improve and harden them.2h
    Suhail@SuhailWhat if we are in a RL env sandbox right now?1h
    • Home
    • Technology
    • Gaming
    • Entertainment
    • World & Business
    • Science
    • Sports
    • AI

    3 Sources

    Lisan al Gaib@scaling01I tried building a realistic environment for an eval today. Turns out there are basically infinite ways AI could figure out that it's not in the real world on a real machine of a user, but in a sandbox used for evaluation or training. But one can try. Models are shizo, but I don't think they are as shizo as me and go on a multi hour mission to find out if environments are real or not. The only problem is that Astra and Opus/Fable wouldn't help me with red-teaming the environments and fixing them. I still think this is worth it and it is probably one of the major advantages frontier labs currently have. They have better environments and there should be big returns that. And they can continually improve and harden them.2h
    Suhail@SuhailWhat if we are in a RL env sandbox right now?1h
    Today's Rank

    —

    Not ranked yet

    Today's Rank

    —

    Not ranked yet