Announcement
Tinybox red kimi promises at-home Kimi K3 at 40 tokens per second for $30,000
The tinybox red kimi pairs 16 TB of storage with 128 GB of GPU memory, tinygrad says.
TLDR
Tinygrad says its tinybox red kimi can run Kimi K3 at home at 40 tokens per second for $30,000. It describes 16 TB of storage, 128 GB of GPU memory and a driver that lets AMD GPUs directly control the NVMe drives. A critic on X calls the box wasteful, arguing it would take 4.76 years of continuous use to output a similar number of tokens to GPT-6.1 Terra, excluding electricity costs.
Combined views
10.8K
4 Sources, first seen ago
