humans& announces ‘weight teleportation’ for reinforcement learning
The GPU-based design compresses weight changes before trainers send updates to samplers.
TLDR
humans& announced that it had open-sourced weight teleportation, a method for moving reinforcement-learning model updates from trainers to samplers. The design uses GPU compression and a CPU-GPU decompression pipeline. In its production RL configuration, the company reports sampler pauses below 0.23 seconds and end-to-end synchronization below four seconds. Those figures describe its setup, not a general speed guarantee.
Combined views
23.6K
11 Sources, first seen ago


