Reactions from ranked influencers
4 posts
Dario wouldn't be wrong. While open-source/weight models are great and incredibly useful, having peak-frontier open-weight models absolutely increases the risks they pose, incl the ones named by OP Note: the frontier is jagged and the concerns apply mainly to cyber, biorisk, surveillance, etc. Having an open-source frontier model that's e.g. mainly frontier at writing CUDA kernels wouldn't be that concerning at all
PREDICTION after kimi k3 successful launch and mogs opus 4.8, Dario Amodei is gonna write an essay explaining how open-weight Chinese AI threatens democracy, national security, and the future of humanity
I don't disagree with you. The tweet was written in the context of K3, which seems to be close or at the frontier, at least acc to some reports. The point is that having peak frontier capabilities in bio and cyber creates additional risks. While closed models can be served using KYC and with monitoring, open-weight models can be run locally by anyone with little monitoring Did you miss https://www.nytimes.com/2026/07/10/us/politics/ai-terrorism-boko-haram-nigeria.html ? Even if we manage to prevent such abuses, safety layers can be abliterated in open models Do you need a public casualty event to be convinced that bio risks or cyber risks pose serious risks? Why should I trust you with models with such capabilities and you me?
@togelius So the only good thing that stops a bad guy with a gun is a random civilian with a gun?
Like any other technology, terrorists will use it to their advantage. Therefore, it is important that everyone has the ability to use this technology and modify it anyway they want, so that they can become resilient to various nefarious actors. It is ridiculously easy to designate anyone you don鈥檛 like as a terrorist. My confidence in whatever regulatory body to not do this is approximately zero. Personally, I think the law should force every model that is served to the public, including frontier models, to be open-sourced. I don鈥檛 believe this will happen, so I hope that economic pressure will make it happen.