Google DeepMind expands Project Genie with Street View integration to generate interactive 3D environments anchored to real-world Google Maps locations
Tool is available for testing by Gemini Ultra users.
@jparkerholder Nice to see, congrats!!
Jack Parker-Holder@jparkerholderGenie going global
#89Ben Poole@POOLIOReal-world models are here! Stoked to share how we're bringing real-world locations to life by integrating Street View into Genie. Try it now at http://labs.google/fx/projectgenie and read the blog for more info: https://blog.google/innovation-and-ai/models-and-research/google-deepmind/project-genie-expands/
#89Ben Poole@POOLIOBy connecting Google’s massive-scale Street View imagery to our most powerful world models, we unlock more realistic simulators for agents and new creative opportunities in your favorite locations. Here’s a watercolor version of sweater frog on a bicycle at the top of Hawk Hill:
Ben Poole@poolioReal-world models are here! Stoked to share how we're bringing real-world locations to life by integrating Street View into Genie. Try it now at http://labs.google/fx/projectgenie and read the blog for more info: https://blog.google/innovation-and-ai/models-and-research/google-deepmind/project-genie-expands/
@poolio great work!
Ben Poole@poolioReal-world models are here! Stoked to share how we're bringing real-world locations to life by integrating Street View into Genie. Try it now at http://labs.google/fx/projectgenie and read the blog for more info: https://blog.google/innovation-and-ai/models-and-research/google-deepmind/project-genie-expands/
#619Jack Parker-Holder@JPARKERHOLDERGenie going global
#619Jack Parker-Holder@JPARKERHOLDERLast year on 60 minutes we talked about the potential to ground our world models with Street View data. Thanks to hard work from @poolio and others this is now possible—Genie can simulate worlds based on real locations, and you can try it too!! Check out the blog for more info 🧞🚀
Ben Poole@poolioReal-world models are here! Stoked to share how we're bringing real-world locations to life by integrating Street View into Genie. Try it now at http://labs.google/fx/projectgenie and read the blog for more info: https://blog.google/innovation-and-ai/models-and-research/google-deepmind/project-genie-expands/
My personal favourite thing to do is revisit my old apartment in NYC, it hits different when the world is dynamic
Jack Parker-Holder@jparkerholderLast year on 60 minutes we talked about the potential to ground our world models with Street View data. Thanks to hard work from @poolio and others this is now possible—Genie can simulate worlds based on real locations, and you can try it too!! Check out the blog for more info 🧞🚀
#619Jack Parker-Holder@JPARKERHOLDERKnew you’d like this @bilawalsidhu …. Also not surprised you know its just the start 🫡
Bilawal Sidhu@bilawalsidhuWoot! You can now simulate real world places by grounding Genie 3 experiences with Street View imagery. Google sitting on the mother lode of real world data, and is starting to put it to work! Let's dive into some prompts & locations I tested...
#849@levelsio@LEVELSIOGTA 7 will be very interesting with real world data or similar 🤔
Ben Poole@poolioReal-world models are here! Stoked to share how we're bringing real-world locations to life by integrating Street View into Genie. Try it now at http://labs.google/fx/projectgenie and read the blog for more info: https://blog.google/innovation-and-ai/models-and-research/google-deepmind/project-genie-expands/
#931Justine Moore@VENTURETWINSCool new launch for Project Genie ✨
World generation is now grounded with Google Maps.
Pick a real-world location, restyle it, and draft a character to explore the scene.
I turned @a16z SF into a desert and wandered around as a camel.
Ben Poole@poolioReal-world models are here! Stoked to share how we're bringing real-world locations to life by integrating Street View into Genie. Try it now at http://labs.google/fx/projectgenie and read the blog for more info: https://blog.google/innovation-and-ai/models-and-research/google-deepmind/project-genie-expands/
@poolio super cool! Need to try it out ;)
Ben Poole@poolioReal-world models are here! Stoked to share how we're bringing real-world locations to life by integrating Street View into Genie. Try it now at http://labs.google/fx/projectgenie and read the blog for more info: https://blog.google/innovation-and-ai/models-and-research/google-deepmind/project-genie-expands/
@holynski_ google elephant flight simulator when
Aleksander Holynski@holynski_My whole life, I've wanted to be an elephant riding a motorcycle through my hometown. Now, it's finally possible.
#1861Aleksander Holynski@HOLYNSKI_My whole life, I've wanted to be an elephant riding a motorcycle through my hometown.
Now, it's finally possible.
Ben Poole@poolioReal-world models are here! Stoked to share how we're bringing real-world locations to life by integrating Street View into Genie. Try it now at http://labs.google/fx/projectgenie and read the blog for more info: https://blog.google/innovation-and-ai/models-and-research/google-deepmind/project-genie-expands/
(p.s., everything looks like I remember it!)
Aleksander Holynski@holynski_My whole life, I've wanted to be an elephant riding a motorcycle through my hometown. Now, it's finally possible.
#1869Shlomi Fruchter@SHLOMIFRUCHTERSince we launched Project Genie, we hear from users that they want to explore worlds built around real locations. Genie now lets you ground your experience in real locations from Street View!
@jparkerholder Such a blast -- congrats! Would love to see new SV panos loaded into context as the user walks around a larger area
Jack Parker-Holder@jparkerholderKnew you’d like this @bilawalsidhu …. Also not surprised you know its just the start 🫡
#1909Bilawal Sidhu@BILAWALSIDHUWoot! You can now simulate real world places by grounding Genie 3 experiences with Street View imagery.
Google sitting on the mother lode of real world data, and is starting to put it to work!
Let's dive into some prompts & locations I tested...
1/6 Driving a google maps themed formula 1 car down the Las Vegas Strip.
Maybe GTA 7 will look more like this than a traditional game?
Bilawal Sidhu@bilawalsidhuWoot! You can now simulate real world places by grounding Genie 3 experiences with Street View imagery. Google sitting on the mother lode of real world data, and is starting to put it to work! Let's dive into some prompts & locations I tested...
2/6 Whizzing around the Palace of Fine Arts as a squirrel riding a scooter - because why the heck not?
Bilawal Sidhu@bilawalsidhu1/6 Driving a google maps themed formula 1 car down the Las Vegas Strip. Maybe GTA 7 will look more like this than a traditional game?
3/6 Typical Austin running around Lady Bird Lake.
Really impressed with the landmarks in this one! And of course I had to try and jump off the bridge :-)
Bilawal Sidhu@bilawalsidhu2/6 Whizzing around the Palace of Fine Arts as a squirrel riding a scooter - because why the heck not?
4/6 Street View Pegman running around the San Francisco Ferry Building
*chefs kiss*
Bilawal Sidhu@bilawalsidhu3/6 Typical Austin running around Lady Bird Lake. Really impressed with the landmarks in this one! And of course I had to try and jump off the bridge :-)
5/6 Boating around Austin's Lady Bird Lake - because why the heck not?
Street View has all sort of special collects done via boats, trekkers and even camels. Put 'em to work!
Bilawal Sidhu@bilawalsidhu4/6 Street View Pegman running around the San Francisco Ferry Building *chefs kiss*
6/6 Walking around the white house (like I said, plenty of indoor street view imagery to pull from!)
Genuinely a cool real world canvas for humans & machines alike.
Bilawal Sidhu@bilawalsidhu5/6 Boating around Austin's Lady Bird Lake - because why the heck not? Street View has all sort of special collects done via boats, trekkers and even camels. Put 'em to work!
#1909Bilawal Sidhu@BILAWALSIDHUIf you enjoyed this thread, show some love ot the original post.
You can also find my in depth write ups and videos on all things AI & spatial intelligence at: https://maptheworld.ai
Bilawal Sidhu@bilawalsidhuWoot! You can now simulate real world places by grounding Genie 3 experiences with Street View imagery. Google sitting on the mother lode of real world data, and is starting to put it to work! Let's dive into some prompts & locations I tested...