Day-zero model support expands to TPU
A post says SGLang provides inference on Nvidia, AMD, Intel and TPU hardware; Miles supports reinforcement learning on Nvidia.
TLDR
The poster says their day-zero model support now includes TPU for the first time, with performance they call optimized and battle-tested for production. They also describe SGLang inference across Nvidia, AMD, Intel and TPU hardware, alongside reinforcement learning on Nvidia with Miles.
Combined views
1.8K
1 Source, first seen ago