Emad Mostaque Predicts Kimi K3 Inference Costs Will Fall 10-50x
Reactions from ranked influencers
4 posts
Larry Ellison on the AI moat, makes more sense now. AI is commoditizing because models use the same public internet data. True competitive edge isn't the model itself anymore, but access to exclusive, proprietary datasets. That is the only moat left. https://x.com/danielisdizzy/status/2028154189960859707/video/1
Great explanation by Emad Mostaque, co-founder of Stability AI. "We’ll see the cost of Kimi K3 drop by 10 to 50 times, I think, over the next few months as it gets optimized. " Basically Kimi K3’s current inference cost is quite high, but that price reflects immature infrastructure, not a permanent technical limit. And that gap will not last long. US-based specialized infrastructure companies will optimize kernels, routing, quantization, batching, memory use, and serving systems around those models once the Kimi K3 weights are available. --- "Right now, it uses twice the number of tokens for the same task compared with GPT-5.6. Again, we’re going to see that cost drop because everyone and their dog is going to optimize the crap out of this. Fireworks has just raised funding at a $17 billion valuation, while others, such as Modal and Baseten, are valued at $10 billion. These are inference providers for open-source models. They’ve all raised around a billion dollars, which they’re now going to spend on optimizing the Chinese model, making it more efficient, and running it. American labs that handle the inference side of things are going to optimize the crap out of this. Therefore, we will see it catch up." ---- From "Peter H. Diamandis" YouTube channel, (full video link in comment)
the full video here on Oracle YT channel https://www.youtube.com/watch?v=4eCFmbX5rAQ
Larry Ellison on the AI moat, makes more sense now. AI is commoditizing because models use the same public internet data. True competitive edge isn't the model itself anymore, but access to exclusive, proprietary datasets. That is the only moat left. https://x.com/danielisdizzy/status/2028154189960859707/video/1 https://twitter.com/rohanpaul_ai/status/2079385730410054096
Yes, the whole "China's coming, so protect the frontier labs" line is just a smoke screen for something much smaller. The model layer itself is not the economy of AI. It's only a slice. If you can reduce the cost of running these models by 10X or 100X, that’s actually rocket fuel for the rest of us down the line. So the very thing the labs fear, price drops, could enlarge the entire pie.