AI Judge changed title after evaluation, original title: "OdysseyML releases Starchild-1, a causal multimodal world model that generates interactive real-time audio-video simulations from continuous user inputs"
Oliver Cameron posted a demo of dynamic interactive scenes.
Introducing Starchild-1 from @odysseyml, the first ever real-time multimodal world model.
This a model that can generate interactive simulations of the world that you can—for the first time ever—hear.
Starchild-1 represents a big step towards a general-purpose world simulator.
Positive users focus on the excitement and potential of OdysseyML's Starchild-1 as the first real-time multimodal world model, while negative users worry it is creepy or overestimates its capabilities.
No Digg Deeper questions have been answered for this story yet.
Starchild-1 is an early step beyond world models that learn only from visual observation, toward systems that learn from richer multimodal interaction with the world.
Introducing Starchild-1 from @odysseyml, the first ever real-time multimodal world model.
This a model that can generate interactive simulations of the world that you can—for the first time ever—hear.
Starchild-1 represents a big step towards a general-purpose world simulator.
We're also releasing an accompanying technical report of Starchild-1, to share our learnings and encourage further research in this direction!
My dream is that models like Starchild-1 unlock entirely new forms of education, gaming, companionship, robotics, and brand new computing devices.
We're so early on this journey, but I'm so excited. The team did truly great work here.
https://odyssey.ml/introducing-starchild-1
My dream is that models like Starchild-1 unlock entirely new forms of education, gaming, companionship, robotics, and brand new computing devices.
We're so early on this journey, but I'm so excited. The team did truly great work here.
https://odyssey.ml/introducing-starchild-1
Starchild-1 is an early step beyond world models that learn only from visual observation, toward systems that learn from richer multimodal interaction with the world.
@olivercameron @odysseyml can it simulate my mom telling me she’s proud of me ???
@olivercameron @odysseyml I need a first ever real-time multimodal world model of my printer
😍😍😍😍
Introducing Starchild-1 from @odysseyml, the first ever real-time multimodal world model.
This a model that can generate interactive simulations of the world that you can—for the first time ever—hear.
Starchild-1 represents a big step towards a general-purpose world simulator.
@olivercameron @odysseyml a serious technical step, as audio forces the model to learn hidden physical and social structure that silent video can often fake.
So many possibilities I can think of right away.
Introducing Starchild-1 from @odysseyml, the first ever real-time multimodal world model.
This a model that can generate interactive simulations of the world that you can—for the first time ever—hear.
Starchild-1 represents a big step towards a general-purpose world simulator.
@olivercameron @odysseyml really excited to see where this goes, the paper summarises it perfectly. congrats team!
@maarcoofdezz @odysseyml Let's be honest we're all in a simulation anyway.
@olivercameron @odysseyml this is pretty cool
@olivercameron @odysseyml 🔥
@roaldvanbuuren @odysseyml Devs was a total inspiration for Starchild-1.
@TiffanyFong @olivercameron @odysseyml Impossible for any asian mother to say that
@olivercameron @odysseyml How long until they realise that they live in a simulation?
@AzizBuilds @odysseyml How long until we realize?
@olivercameron @odysseyml This is starting to feel like the future of simulation itself.
@olivercameron @odysseyml can it recreate what it’d feel like for my girlfriend and me to explore Mars?
Devs has become real… or devs was always real and we are not? Or the simulation in devs is real but the non simulation in devs is not real and the viewer is the simulator? Or the viewer is a simulation and Devs is real and the simulation in Devs is not real? Error…
Anyways, very cool!
@TiffanyFong @olivercameron @odysseyml There are limitations to AI as well… 😕
@olivercameron @odysseyml So it’s like Higgsfield with voice mode plus a big eyeball?