Kimi K3 is out. 2.8T parameters. 1.4 TB of weights, frontier-level performance.
Serving it on your own infra is the hard part - you need multi-node inference spread across every cluster you can grab capacity from. And then autoscaling, cache-aware routing, PD disaggregation -…
Kimi K3 is out. 2.8T parameters. 1.4 TB of weights, frontier-level performance.
Serving it on your own infra is the hard part - you need multi-node inference spread across every cluster you can grab capacity from. And then autoscaling, cache-aware routing, PD disaggregation -…