The reconstructed dataset is hosted on Hugging Face.
Scale robots data by converting YouTube videos into 4D object interaction trajectories!
Introduce EgoInfinity:
a web-scale (14.6 yrs, 142M clips) data engine that automatically lifts Youtube videos into 4D hand-object interaction, and retargets for robot learning
Not only a dataset, but a modular, upgradable engine
HF Space: https://huggingface.co/spaces/Rice-RobotPI-Lab/EgoInfinity
Many users praised EgoInfinity's extraction of 4D hand-object data from YouTube clips as a game changer for robot learning and thanked the team for open-sourcing the work.
No Digg Deeper questions have been answered for this story yet.
it's getting easier to scale robotics data from purely the internet
Introduce EgoInfinity:
a web-scale (14.6 yrs, 142M clips) data engine that automatically lifts Youtube videos into 4D hand-object interaction, and retargets for robot learning
Not only a dataset, but a modular, upgradable engine
HF Space: https://huggingface.co/spaces/Rice-RobotPI-Lab/EgoInfinity
Introduce EgoInfinity:
a web-scale (14.6 yrs, 142M clips) data engine that automatically lifts Youtube videos into 4D hand-object interaction, and retargets for robot learning
Not only a dataset, but a modular, upgradable engine
HF Space: https://huggingface.co/spaces/Rice-RobotPI-Lab/EgoInfinity
@VectorWang2 Mind blown! Tks for putting this together!!
The dataset is open to anyone to use and contribute. The pipeline is modular and upgradable. Come scale things up even without any hardwares!
Project Page: https://rice-robotpi-lab.github.io/EgoInfinity/ Paper: https://arxiv.org/abs/2606.17385 Codes: https://github.com/Rice-RobotPI-Lab/EgoInfinity Dataset: https://huggingface.co/datasets/Rice-RobotPI-Lab/egoinfinity
@VectorWang2 Absolute game changer! Thanks for the open-sourcing
@AlenGabs @VectorWang2 The videos alone are good enough IMO ;)
@VectorWang2 @tommiekerssies
@micoolcho Just a start! As a modular platform, it still can be and needs to be upgraded and improved by us and everyone in the community! Just like XLeRobot, I am just offering a path for everyone to build upon.
@thejerrycheng Thanks Jerry! Let’s build it together!
@VectorWang2 @antoinemarcel just shared this in our gc. Looks great. Passing this on to a handful of people now.
@VectorWang2 The demos look fantastic. Creating an SE(3)-compliant coordinate space for every camera angle is the key. Here is our take:
@VectorWang2 @nicks_robots
@VectorWang2 Ming blowing, it's a game changer! Thank you for it
@VectorWang2 amazing work!
@VectorWang2 vaporware or fr? most such repos hide a critical component, are you fr fr?
@VectorWang2 @astridwilde1
@VectorWang2 fire!!!
@VectorWang2 @krithikas12
@VectorWang2 @grantg07
@VectorWang2 ❤️
