How can robots learn dexterous manipulation from human demonstrations at scale? Excited to share CHORD: Learning Dexterous Manipulation Using Contact Wrench Guidance From Human Demonstration. CHORD learns from human demos by focusing not only on where contact happens, but how that contact moves the object through force and torque guidance. This unified contact-wrench representation carries human manipulation skills across diverse behaviors, long-horizon tasks, whole-body embodiments, and real-world hardware. We evaluated CHORD on large-scale, long-horizon, contact-rich tasks paired with human demonstrations, spanning rigid, articulated, and multi-object manipulation. At scale: * 82.12% average success across 1,831 tasks * 90.77% whole-body manipulation success * 4,739 sim-ready dexterous manipulation benchmark * Transfer to real dexterous hands
Project page: https://nvidia-isaac.github.io/video_to_data/chord/ Tech report: https://nvidia-isaac.github.io/video_to_data/chord/chord.pdf Code will be released soon as part of Video to Data repo https://github.com/nvidia-isaac/video_to_data/tree/main, our end-to-end pipeline for converting human demonstration videos into simulation-ready assets and physics-grounded robot training data. Huge thanks to amazing contributors: @zhu_xinghao , Zixi Liu, Shalin Jain, Chenran Li, Milad Noori, Huihua Zhao, John Welsh, @michaelv03, Wei Liu, @TingwuWang , Xingye (Dennis) Da, @zhengyiluo, Vishal Kulkarni, @sNaema, @yukez, @DrJimFan, @bowenwen_me, @danfei_xu, @SohaPouya, @Dr_YanChang. #Robotics #PhysicalAI #DexterousManipulation #RobotLearning #NVIDIA
