Builder Challenges High-Fidelity Simulators In RL Robotics Sim2Real

Unfortunately all the stuff out there is way too stuck on hifi sim accuracy. People trying to solve the sim2real problem by spending more compute on the sim. So I need to do it myself. I'm going to do in in 2d to learn, then take it to 3d. It's not going to be easy

You might say that, because they're using an asymmetric critic / actor, the critic needs the pure accurate state.. but I've beaten their wallclock training time by 2x without the asymmetric critic! Mine uses 93 obs for both, not 93/207. Is it actually necessary?

imo no

This is the sort of programming that LLMs don't really help you with. Just C neovim and some music.

I'm going to make a leg that kicks a soccer ball in 2d, an env that can be learned by a single GPU. I'm going to train it, end to end, and use my learning from that to do 3D

@yacineMTB If you don’t need fat old PyTorch u can mutate and learn online