Google DeepMind updates Project Genie to integrate directly with Google Maps Street View for generating interactive 3D environments from real U.S. locations · Digg

Google DeepMind updates Project Genie to integrate directly with Google Maps Street View for generating interactive 3D environments from real U.S. locations · Digg

Posts from X

Most Activity

VIEWS279KREPLIES70

Google DeepMind@GoogleDeepMind

Project Genie 🤝 @GoogleMaps Street View

You can now take real U.S. places and transform them into new, interactive worlds. 🌍

39d279K1.6K464

BOOKMARKS1.7KLIKES2.9KRETWEETS263

Bilawal Sidhu@bilawalsidhu

Woot! You can now simulate real world places by grounding Genie 3 experiences with Street View imagery.

Google sitting on the mother lode of real world data, and is starting to put it to work!

Let's dive into some prompts & locations I tested...

42d236.2K2.9K1.7K

Google@Google

Project Genie is a @GoogleLabs experiment that lets you simulate dynamic worlds you can navigate in real time with Genie, our general-purpose world model.

Today, we’re connecting Project Genie to nearly 20 years of Street View data from Google Maps — so you can now build interactive spaces based on real-world locations.

Street View imagery in Project Genie is available now for places in the U.S., and will expand to more locales over time.

#GoogleIO

42d136.8K946311

Ben Poole@poolio

Real-world models are here! Stoked to share how we're bringing real-world locations to life by integrating Street View into Genie. Try it now at http://labs.google/fx/projectgenie and read the blog for more info: https://blog.google/innovation-and-ai/models-and-research/google-deepmind/project-genie-expands/

42d201.7K604353

Justine Moore@venturetwins

Cool new launch for Project Genie ✨

World generation is now grounded with Google Maps.

Pick a real-world location, restyle it, and draft a character to explore the scene.

I turned @a16z SF into a desert and wandered around as a camel.

Ben Poole@poolio

Real-world models are here! Stoked to share how we're bringing real-world locations to life by integrating Street View into Genie. Try it now at http://labs.google/fx/projectgenie and read the blog for more info: https://blog.google/innovation-and-ai/models-and-research/google-deepmind/project-genie-expands/

42d57.4K345218

Bilawal Sidhu@bilawalsidhu

Google just turned Street View into a video game.

The mother lode of ground level data -- 280 billion real world panoramas, now playable in real time.

Here's everything you need to know in 7 mins:

00:00 Genie 3 Grounded In Reality 00:44 Real-time Demos! 03:48 The Bigger Picture 05:36 Current Limitations 06:54 World Model Resources

40d15.1K177105

Justine Moore@venturetwins

I got to "play" a world model in real life.

The @GoogleDeepMind folks set up a crazy demo for Genie.

You select glowing orbs to represent your scene and character. It loads the world in the model, and you navigate with joysticks like a video game 🕹️

42d33.7K19849

@levelsio@levelsio

GTA 7 will be very interesting with real world data or similar 🤔

Ben Poole@poolio

Real-world models are here! Stoked to share how we're bringing real-world locations to life by integrating Street View into Genie. Try it now at http://labs.google/fx/projectgenie and read the blog for more info: https://blog.google/innovation-and-ai/models-and-research/google-deepmind/project-genie-expands/

42d36.9K15640

Bilawal Sidhu@bilawalsidhu

1/6 Driving a google maps themed formula 1 car down the Las Vegas Strip.

Maybe GTA 7 will look more like this than a traditional game?

Bilawal Sidhu@bilawalsidhu

Woot! You can now simulate real world places by grounding Genie 3 experiences with Street View imagery.

Google sitting on the mother lode of real world data, and is starting to put it to work!

Let's dive into some prompts & locations I tested...

42d10.8K9428

Rohan Paul@rohanpaul_ai

World models are moving into wild territory. Project Genie just turned Google Maps Street View into a promptable world simulator. Google AI Ultra users can now turn any real U.S. locations into interactive AI-made scenes.

39d6.1K4424

Google DeepMind@GoogleDeepMind

Street View imagery in Project Genie is rolling out to all eligible Google AI Ultra subscribers globally (18+).

Try it in @GoogleLabs, tap the Maps pin, choose a place in the U.S., select a style, and start exploring → https://goo.gle/4dCyX8V

39d15.6K6216

Jack Parker-Holder@jparkerholder

Last year on 60 minutes we talked about the potential to ground our world models with Street View data. Thanks to hard work from @poolio and others this is now possible—Genie can simulate worlds based on real locations, and you can try it too!! Check out the blog for more info 🧞🚀

Ben Poole@poolio

Real-world models are here! Stoked to share how we're bringing real-world locations to life by integrating Street View into Genie. Try it now at http://labs.google/fx/projectgenie and read the blog for more info: https://blog.google/innovation-and-ai/models-and-research/google-deepmind/project-genie-expands/

42d8.1K6412

Ben Poole@poolio

By connecting Google’s massive-scale Street View imagery to our most powerful world models, we unlock more realistic simulators for agents and new creative opportunities in your favorite locations. Here’s a watercolor version of sweater frog on a bicycle at the top of Hawk Hill:

Ben Poole@poolio

Real-world models are here! Stoked to share how we're bringing real-world locations to life by integrating Street View into Genie. Try it now at http://labs.google/fx/projectgenie and read the blog for more info: https://blog.google/innovation-and-ai/models-and-research/google-deepmind/project-genie-expands/

42d5.3K5610

Bilawal Sidhu@bilawalsidhu

6/6 Walking around the white house (like I said, plenty of indoor street view imagery to pull from!)

Genuinely a cool real world canvas for humans & machines alike.

Bilawal Sidhu@bilawalsidhu

5/6 Boating around Austin's Lady Bird Lake - because why the heck not?

Street View has all sort of special collects done via boats, trekkers and even camels. Put 'em to work!

42d7.2K4010

👩‍💻 Paige Bailey@DynamicWebPaige

🪨 Road cuts are one of the most exciting parts of travel, for a geologist – being able to see exposed strata on either side of a highway.

🙌 Can't wait to test out this with project Genie, all over the world, without having to sit in a plane for 10+ hours to get there. 😁

Miriam Daniel@miriamkdaniel

Imagine driving down one of the most picturesque highways on the Pacific Coast (Highway 1) in a race car… now I can use Project Genie, connected with Street View, to bring that to life in vivid detail!

At #GoogleIO, we announced that we’re bringing Google Street View into Project Genie, so you can create and explore imaginative, interactive worlds anchored in real places.

Available to eligible Google AI Ultra Subscribers globally.

Great collab from @jmbherbert, @jparkerholder, @poolio, @drivascos + many others from @GoogleDeepMind and @GoogleLabs.

39d5.7K306

Jack Parker-Holder@jparkerholder

Genie going global

diego rivas@drivascos

🚀🚀 Today, we are starting to roll out Project Genie to Ultra users globally, and bringing the power of Street View to ground your generations. You can read more about it here: https://blog.google/innovation-and-ai/models-and-research/google-deepmind/project-genie-expands/

42d10.4K442

Google@Google

We’re also expanding access to Project Genie — including the new Street View capability — to more people around the globe. Starting today, it’s gradually rolling out to all eligible Google AI Ultra $200 subscribers globally (18+).

Learn more about how to bring your imagination to life with Project Genie → https://goo.gle/4nBitlQ #GoogleIO

42d12.6K215

Bilawal Sidhu@bilawalsidhu

If you enjoyed this thread, show some love ot the original post.

You can also find my in depth write ups and videos on all things AI & spatial intelligence at: https://maptheworld.ai

Bilawal Sidhu@bilawalsidhu

Woot! You can now simulate real world places by grounding Genie 3 experiences with Street View imagery.

Google sitting on the mother lode of real world data, and is starting to put it to work!

Let's dive into some prompts & locations I tested...

42d3.5K89

Jack Parker-Holder@jparkerholder

Knew you’d like this @bilawalsidhu …. Also not surprised you know its just the start 🫡

Bilawal Sidhu@bilawalsidhu

Woot! You can now simulate real world places by grounding Genie 3 experiences with Street View imagery.

Google sitting on the mother lode of real world data, and is starting to put it to work!

Let's dive into some prompts & locations I tested...

42d3.5K236

Bilawal Sidhu@bilawalsidhu

3/6 Typical Austin running around Lady Bird Lake.

Really impressed with the landmarks in this one! And of course I had to try and jump off the bridge :-)

Bilawal Sidhu@bilawalsidhu

2/6 Whizzing around the Palace of Fine Arts as a squirrel riding a scooter - because why the heck not?

42d9.9K295