World Labs Unveils Real-to-Sim Platform for Robot Training
SceniX integration enables generative simulations aligned with real robot dynamics and interactions.
TLDR
World Labs announced early results after SceniX joined the company. The Real-to-Sim-to-Real platform uses generative world models to convert physical robot tasks, sensors, objects, and environments into reusable, controllable simulations. These preserve task-relevant observations and dynamics, allowing teams to train policies, test variations, and detect failures without repeated hardware experiments. The work targets the acute data bottleneck in robotics, distinct from abundant internet text used for language models. Stakeholders describe it as a milestone for scaling aligned virtual worlds, with further development planned.
Combined views
162.3K
15 Sources, first seen ago
Sources
YL 
Yunzhu Li@YunzhuLiYZDeeply proud of what the SceniX team has built and excited to take it forward at @theworldlabs. Our real-to-sim-to-real platform enables scalable robot training and evaluation in worlds aligned with reality. This is an important milestone, and only the beginning. ππ€β¦
- likes: 105
- replies: 6
- bookmarks: 17
- reposts: 12
WL World Labs@theworldlabsTo scale robot intelligence, we must scale the worlds in which robots learn. π€π https://twitter.com/drfeifei/status/2082137335052075298
- likes: 49
- replies: 5
- bookmarks: 13
- reposts: 7
A1 a16z@a16zWorld Labs CEO Dr. Fei-Fei Li & SceniX Co-Founder Yunzhu Li on the data bottleneck in robotics and how world models help: "The lack of data in training, the lack of data in evaluation, this is very, very different from language models, where data is abundant on the internet."β¦
- likes: 247
- replies: 16
- bookmarks: 92
- reposts: 39
AC Andrew Carr π€Έ@andrew_n_carrIf there is one graph that you should internalize for robotics, it is this one. Specifically the graph of real world success rate against simulation success rate. Yes, it's a line, and yes world labs did some amazing work. But look at the error! That error shows the exactβ¦
- likes: 9
- replies: 0
- bookmarks: 3
- reposts: 1
DX Danfei Xu@danfei_xuBig fan of @YunzhuLiYZ & co.βs work on real2sim2real. Congratulations! In an era of chasing the next buzzword, I have the deepest respect for teams that make a focused bet and have the conviction to stick with it. https://twitter.com/YunzhuLiYZ/status/2082139032398492089
- likes: 45
- replies: 1
- bookmarks: 11
- reposts: 7
YL Yunzhu Li@YunzhuLiYZThank you so much, Danfei! Big fan of your work too, and excited to see what's next from you! We've believed deeply in real2sim2real and are excited to keep pushing it forward at World Labs. Sharing a sim-real side-by-side example here. More in our blog:β¦
- likes: 118
- replies: 0
- bookmarks: 54
- reposts: 10