Experts Question Fewer Actors Assumption in AI Safety
Policy expert Séb Krier and academic Boaz Barak question whether fewer AI developers improve safety.
Séb Krier, AGI Policy Development Lead at Google DeepMind, retweeted a post asking why alignment researchers assume fewer actors equal better safety. Boaz Barak, a Harvard professor and OpenAI alignment researcher, replied that he agrees and welcomes competitors such as Anthropic. Barak stated he does not view a single actor as a path to a good future and referenced his blog post arguing that decentralized outcomes cannot be reached through centralized means. The exchange occurred among visible replies on the platform.
Combined views
3.9K
2 posts, first seen 11h ago
Reactions
2 postsTJ 
Theo Jaffee@theojaffee@_NathanCalvin Why do so many alignment people assume that fewer actors = better safety? This seems *extremely* unintuitive to me. If there were one company working on ASI I think this would drastically increase misaligned singleton risk
- likes: 61
- replies: 15
- bookmarks: 4
- reposts: 2
BB Boaz Barak@boazbaraktcsI agree with this take. I am happy Anthropic and other OpenAI competitors exist, and don't think a single actor is a path to a good future. As I said in my blog post "we may not be able to get to a decentralized future via centralized means"
- likes: 36
- replies: 1
- bookmarks: 5
- reposts: 1