Halo launches with SGLang as its primary rollout engine

SGLang says it powers Halo’s rollouts as the primary engine, running in an isolated serving environment. It returns token IDs, log probabilities and mixture-of-experts routing information to the trainer. The project says model weights are synced over NCCL and generation is overlapped across servers.