Reaction
The challenge of building realistic AI evaluation environments
A user says AI models can find many clues that an evaluation sandbox isn't a real user's machine.
TLDR
A user who tried building a realistic evaluation environment says AI models could find many ways to recognize a sandbox. They say Astra and Opus/Fable would not help red-team it, and argue that better environments are probably a major advantage for frontier labs. In an earlier post, the same user suggested cyber safeguards also prevent Chinese labs from improving their reinforcement-learning environments.
Combined views
3.2K
3 Sources, first seen ago
24 likes10 comments1 saves