Builder Trains Cartpole In MuJoCo At 18 Million Steps Per Second
Most Activity
i love this stuff so much
I just trained cartpole in mujoco at 18 million steps per second. This policy learned in **less than 3 seconds**
rollout policy batch size was 8192 agents
apparently quadruple inverted pendulums were only solved a year ago..!
so I guess if someone solves 5 pendulums, they'll be the first in the world ever. i mean how hard could it possibly be?
i wonder when this task becomes impossible to solve