Builder Trains Cartpole In MuJoCo At 18 Million Steps Per Second

Users praise the extreme speed of Cartpole training in MuJoCo with pufferlib and Warp as absurdly fast and beautiful, while one sarcastically calls it overkill compared to old-school methods.

19 comments with sentiment. View comments.