Reactions from ranked influencers
24 posts
"Kimi K3 performs significantly below the most recent frontier cyber-capable models" On UK AISI's cyber range "The Last Ones" Kimi-K3 reaches on average step 17 out of 32. This seems to be around the level of Opus 4.6, a 6 month old model.…
sometimes you just got to listen to Lisan
Secretary @howardlutnick is right. The Kimi Panic needs to stop. — American frontier models are still ahead. When you factor in what’s in the lab, the gap is even larger. As long as we keep releasing, we will stay ahead. Let our horses run. — As Ben Thompson showed, Kimi’s…
Okay but now do it with the classifiers blocking you from using the actual frontier models. This is an irrelevant point if no one can use them. https://twitter.com/CommerceGov/status/2080341953086886387
Overall, this seems to put K3 in cyber in the 3-9mo range. However, aggregate and avg scores should be interpreted with caution, as for safety evals, the worst outcome is what you should look at/prepare for. https://twitter.com/xeophon/status/2080350110400049393