Elizabeth Barnes, founder and CEO of METR, proposed establishing an office of net assessment for AI risk that adapts national security methods used to evaluate threats from rogue states
Proposal appeared in a reply on assessing risks from tech firms and governments.
@BethMayBarnes Do it, please!
Start maybe with a group of humans, compare to a team. This is the new hackathon!
Elizabeth Barnes@BethMayBarnes@krishnanrohit Yeah, I think it would be great to have an "office of net assessment for AI risk" that uses analogous methods to those for used by natsec community for assessing the risks from rogue/adversary states.
@BethMayBarnes I see what you did there! Would really like a market but let's talk.
Elizabeth Barnes@BethMayBarnes@krishnanrohit It's on our very long todo list :P but if you know anyone who could start a team at METR or new org doing this I'd love to chat / help them find funding etc
@krishnanrohit On your actual question - I'd guess that it depends a bit on the exact operationalization - is this "if they were pursuing that objective in a similar way to how they pursue other goals" vs "if most/all individuals inside that organization were coordinated on this objective"
rohit@krishnanrohit@BethMayBarnes I wonder if we could use the same capabilities view to think of other power-centers - like can Google or JP Morgan cause human permanent disempowerment? can North Korea? can the Pentagon? Honestly not sure of the answer, and it would be a great thing for METR to publish.
@krishnanrohit It's on our very long todo list :P but if you know anyone who could start a team at METR or new org doing this I'd love to chat / help them find funding etc
rohit@krishnanrohit@BethMayBarnes Do it, please! Start maybe with a group of humans, compare to a team. This is the new hackathon!