Elizabeth Barnes, METR founder and CEO, says experts are not on top of the AI situation and that assumptions of control from outside the field do not hold
Nate Soares quoted and supported the post on AI oversight gaps
Yeah, I don't think I've ever met someone who has directly worked for an extended period on safety or security at an AI company who thinks things are fine readiness wise or incentive wise etc.
Sometimes people outside the field say things like “The AI situation can’t be that bad, there must be experts who are on top of it”. As “an expert”, I would like to be clear that we are *not* on top of it. Some key aspects of the situation IMO:
Some are more optimistic, more pessimistic etc. but no one is like, I can just retire safely now (and many can afford to)...
Yeah, I don't think I've ever met someone who has directly worked for an extended period on safety or security at an AI company who thinks things are fine readiness wise or incentive wise etc.
I agree with this and the rest of the thread
Sometimes people outside the field say things like “The AI situation can’t be that bad, there must be experts who are on top of it”. As “an expert”, I would like to be clear that we are *not* on top of it. Some key aspects of the situation IMO:
AI is my favorite technology ever. I think future AIs could help people solve all the worst problems in the world and create enormous amounts of fun and meaning.
So it's especially sad and upsetting that we're developing it in such a stupid, reckless way.
Sometimes people outside the field say things like “The AI situation can’t be that bad, there must be experts who are on top of it”. As “an expert”, I would like to be clear that we are *not* on top of it. Some key aspects of the situation IMO:
It doesn't have to be this way. We could eat our cake and have it too. But it takes coordination!
We're inventing new types of minds, that will be able to think faster and better than any human ever could. If the world was going to coordinate on ONE thing, let it be this thing!
AI is my favorite technology ever. I think future AIs could help people solve all the worst problems in the world and create enormous amounts of fun and meaning. So it's especially sad and upsetting that we're developing it in such a stupid, reckless way.
I would rather we coordinate over this than over nuclear weapons. Over synthetic biology. Creating artificial minds that can vastly outstrip our cognitive capabilities... that is the ultimate test of a species. Can we do this in a way that goes well for us and the AIs?
It doesn't have to be this way. We could eat our cake and have it too. But it takes coordination! We're inventing new types of minds, that will be able to think faster and better than any human ever could. If the world was going to coordinate on ONE thing, let it be this thing!
I greatly appreciate all the hard work @BethMayBarnes and the rest of the @METR_Evals team is doing! We're in a better situation because of it. We need far more good work like this.
I would rather we coordinate over this than over nuclear weapons. Over synthetic biology. Creating artificial minds that can vastly outstrip our cognitive capabilities... that is the ultimate test of a species. Can we do this in a way that goes well for us and the AIs?
yep. the flop is also out of control and unmanaged.
Sometimes people outside the field say things like “The AI situation can’t be that bad, there must be experts who are on top of it”. As “an expert”, I would like to be clear that we are *not* on top of it. Some key aspects of the situation IMO:
@ohlennart You had one job, Lennart.
yep. the flop is also out of control and unmanaged.
oh dear.
Sometimes people outside the field say things like “The AI situation can’t be that bad, there must be experts who are on top of it”. As “an expert”, I would like to be clear that we are *not* on top of it. Some key aspects of the situation IMO:
Props to Elizabeth for stating her view bluntly and candidly.
Sometimes people outside the field say things like “The AI situation can’t be that bad, there must be experts who are on top of it”. As “an expert”, I would like to be clear that we are *not* on top of it. Some key aspects of the situation IMO: