/AI6h ago

NVIDIA open-sources OmniDreams, a generative world model for real-time, closed-loop autonomous vehicle simulation

It generates multi-view driving scenes with real-time trajectory overlays.

--0--
Original posts
Zian Wang
Quote posts
Jay Wu
Xindi Wu
Sanja Fidler#512
Reposts
Jonathan Lorraine
Sanja Fidler
Robert Scoble#321
Original postSanja Fidler#512
Zian Wang@zianwang97

🚀 What if physical AI policies could interact with generated worlds in real time?

Introducing OmniDreams, a generative world model for closed-loop autonomous vehicle simulation.

Tech report, code, models, and data samples are available now.

Project: https://research.nvidia.com/labs/sil/projects/omnidreams-blog/ Code: https://github.com/nv-tlabs/omni-dreams Model: https://huggingface.co/collections/nvidia/nvidia-omnidreams

Join the #omnidreams discord channel: https://discord.gg/bsjzh4uZ

10:21 AM · Jun 3, 2026 · 13.9K Views
Sentiment
Sentiment building, check back later.
Cluster Engagement
-
Views
-
Comments
-
Reposts
-
Bookmarks
Expand data
Posts from X
Most Activity
Most ActivityTimeline
VIEWS4.2KBOOKMARKS18LIKES53RETWEETS12
Sanja Fidler@FidlerSanja

Real time world model NVIDIA OmniDreams now open sourced!

If you are at CVPR, we invite you to also check out a live demo you can try out at the NVIDIA booth.

Zian Wang@zianwang97

🚀 What if physical AI policies could interact with generated worlds in real time?

Introducing OmniDreams, a generative world model for closed-loop autonomous vehicle simulation.

Tech report, code, models, and data samples are available now.

Project: https://research.nvidia.com/labs/sil/projects/omnidreams-blog/ Code: https://github.com/nv-tlabs/omni-dreams Model: https://huggingface.co/collections/nvidia/nvidia-omnidreams

Join the #omnidreams discord channel: https://discord.gg/bsjzh4uZ

5hViews 4.2KLikes 53Bookmarks 18
REPLIES1
Jay Wu@jayzhangjiewu

OmniDreams is now fully open source!

An interactive real-time world model for closed-loop autonomous vehicle simulation.

🔗 Project: https://research.nvidia.com/labs/sil/projects/omnidreams-blog/ 💻 Code: https://github.com/nv-tlabs/omni-dreams 🤗 Models: https://huggingface.co/collections/nvidia/nvidia-omnidreams

Zian Wang@zianwang97

🚀 What if physical AI policies could interact with generated worlds in real time?

Introducing OmniDreams, a generative world model for closed-loop autonomous vehicle simulation.

Tech report, code, models, and data samples are available now.

Project: https://research.nvidia.com/labs/sil/projects/omnidreams-blog/ Code: https://github.com/nv-tlabs/omni-dreams Model: https://huggingface.co/collections/nvidia/nvidia-omnidreams

Join the #omnidreams discord channel: https://discord.gg/bsjzh4uZ

4hViews 1.4KLikes 9Bookmarks 1