TwinDEX Lets Robots Learn Dexterous Tasks from Human Wearables
X Square Robot's co-designed wearable and robot hands capture human demonstrations for dexterous tasks.
X Square Robot and team member Jialei Huang presented TwinDEX. The system pairs two three-finger manipulators with matching kinematics, contact surfaces, and sensors. One version is worn by humans to record demonstrations. The matching unit mounts on the robot for deployment. Posts from the company and researchers state this setup let a robot finish a chemistry experiment using only the human-collected data, with no separate on-robot training sessions required.
What if a dexterous robot could learn a 20+ step chemistry experiment without a single on-robot training demo? Meet TwinDEX: a pair of co-designed, three-finger, nine-DoF dexterous manipulation interface: one wearable for data collection, one for robot deployment. The twinned…
TwinDEX Lets Robots Learn Dexterous Tasks from Human Wearables
X Square Robot's co-designed wearable and robot hands capture human demonstrations for dexterous tasks.
Reactions
CP 
Chris Paxton@chris_j_paxtonSeeing that completing long horizon tasks is a data problem -- that with good tools like these co-designed isomorphic dexterous data collection tools, you can accomplish long horizon tasks with less data than we might have expected…
- likes: 60
- replies: 3
- bookmarks: 38
- reposts: 3
AA Amit Amir Anthony@AmitWorldPeace@Just_sharon7 The real breakthrough isn't the robot doing chemistry—it's learning complex skills from human demonstrations without robot teleoperation. 🤖
AM Alex Moore@heyalexmoore@iam_chonchol Co-designing hardware for learning is a smart approach.
WP wisdom pan@wisdompan_ai@XRoboHub A very amazing job
AL Alex@AlexCodeRx@Ubermenscchh Fantastic