Anthropic has chosen the *opposite* of the safe path: they are allowing themselves, the current top lab, to use their top model for frontier AI research. They've said they'll sabotage others who try.
This means the AI frontier advances, & power imbalance increases.
It also has the critical benefit of avoiding a dangerous power imbalance.
Users criticized Anthropic's frontier AI push and resulting power imbalance as souring the company's image, predicting market forces would erode their temporary edge.
(To be clear, *I* don't think we should try to slow down recursive AI self improvement - I think we should open it up and democratize it as much as possible. My point is: if *you* claim we should slow down, and you have the best model, you should ensure your org can't use it.)
Anthropic has chosen the *opposite* of the safe path: they are allowing themselves, the current top lab, to use their top model for frontier AI research. They've said they'll sabotage others who try.
This means the AI frontier advances, & power imbalance increases.
@jeremyphoward The gravitational pull of markets will likely diffuse whatever their edge is more widely over time. Def sours the vibes of the company though
@jeremyphoward scronkfinkle, is it?...
@jeremyphoward Anthropic maybe winning today, but not for long.
Anthropic has chosen the *opposite* of the safe path: they are allowing themselves, the current top lab, to use their top model for frontier AI research. They've said they'll sabotage others who try.
This means the AI frontier advances, & power imbalance increases.
It also has the critical benefit of avoiding a dangerous power imbalance.