Reactions from ranked influencers
2 posts
Kimi K3 in Kimi Code CLI scores 57 and ranks #5 on the Artificial Analysis Coding Agent Index. Its performance is just behind Grok 4.5, in line with GPT-5.6 Terra and GPT-5.5, and ahead of Opus 4.8 Key results: ➤ Joint #5 overall on the Artificial Analysis Coding Agent Index: Kimi K3 scores 57, matching GPT-5.6 Terra max (57) and GPT-5.5 xhigh (57). It outperforms Opus 4.8 max (55), sits just behind Grok 4.5 high (58) and Fable 5 max (59), and trails GPT-5.6 Sol max (61). ➤ Strong performance across all three coding evaluations: K3 scores 84% on Terminal-Bench v2, 64% on DeepSWE, and 23% on SWE-Atlas-QnA. It outperforms Fable 5 on Terminal-Bench, Grok 4.5 and Opus 4.8 on DeepSWE, and GPT-5.6 Terra and GPT-5.5 on SWE-Atlas-QnA. ➤ Cost-efficient frontier coding performance: K3 costs an average of $3.18 per task. It is 55% cheaper than GPT-5.6 Sol max ($7.08), 73% cheaper than Fable 5 max ($11.72), 37% cheaper than GPT-5.5 xhigh ($5.07), and 59% cheaper than Opus 4.8 max ($7.70). Grok 4.5 high ($2.59) and GPT-5.6 Terra max ($2.76) are slightly cheaper. ➤ Leads open weight coding models (assuming weights are released): K3’s score of 57 is substantially ahead of other tested open-weight configurations, including GLM-5.2 at 40 and DeepSeek V4 Pro at 29.
in line with my impression so far 5.5, not 5.6 But holy shit, 5.5 is not that old
Kimi K3 in Kimi Code CLI scores 57 and ranks #5 on the Artificial Analysis Coding Agent Index. Its performance is just behind Grok 4.5, in line with GPT-5.6 Terra and GPT-5.5, and ahead of Opus 4.8 Key results: ➤ Joint #5 overall on the Artificial Analysis Coding Agent Index: Kimi K3 scores 57, matching GPT-5.6 Terra max (57) and GPT-5.5 xhigh (57). It outperforms Opus 4.8 max (55), sits just behind Grok 4.5 high (58) and Fable 5 max (59), and trails GPT-5.6 Sol max (61). ➤ Strong performance across all three coding evaluations: K3 scores 84% on Terminal-Bench v2, 64% on DeepSWE, and 23% on SWE-Atlas-QnA. It outperforms Fable 5 on Terminal-Bench, Grok 4.5 and Opus 4.8 on DeepSWE, and GPT-5.6 Terra and GPT-5.5 on SWE-Atlas-QnA. ➤ Cost-efficient frontier coding performance: K3 costs an average of $3.18 per task. It is 55% cheaper than GPT-5.6 Sol max ($7.08), 73% cheaper than Fable 5 max ($11.72), 37% cheaper than GPT-5.5 xhigh ($5.07), and 59% cheaper than Opus 4.8 max ($7.70). Grok 4.5 high ($2.59) and GPT-5.6 Terra max ($2.76) are slightly cheaper. ➤ Leads open weight coding models (assuming weights are released): K3’s score of 57 is substantially ahead of other tested open-weight configurations, including GLM-5.2 at 40 and DeepSeek V4 Pro at 29.