Reactions from ranked influencers
3 posts
LLM Infra folks are having too much fun these days
Incredible open-weight model! The gap between open and closed AI has nearly vanished! Interested in the tech behind it? Here are some background topics. Kimi Delta Attention (KDA): https://youtu.be/pUCWwGR5WmQ Attention Residual (AttnRes): https://youtu.be/LSHTkbnmzy4 Mixture of Experts (MoE): https://youtu.be/0QQlYR1r6pQ
Incredible open-weight model! The gap between open and closed AI has nearly vanished! Interested in the tech behind it? Here are some background topics. Kimi Delta Attention (KDA): https://youtu.be/pUCWwGR5WmQ Attention Residual (AttnRes): https://youtu.be/LSHTkbnmzy4 Mixture of Experts (MoE): https://youtu.be/0QQlYR1r6pQ
Introducing Kimi K3: Open Frontier Intelligence 🔹 2.8 Trillion Parameters, 1 Million Context, Native Multimodal 🔹 Kimi Delta Attention enables up to 6.3x faster decoding in million-token contexts 🔹 Attention Residuals deliver ~25% higher training efficiency at <2% additional cost 🔹 Built for long-horizon agentic coding and self-evolving workflows Kimi K3 is now live on on http://Kimi.com, Kimi Work, Kimi Code, and the Kimi API. Open Weights by July 27, 2026. 🔗 API: http://platform.kimi.ai 🔗 Tech blog: http://kimi.com/blog/kimi-k3