Google demonstrated real-time interaction with its Gemini model inside worlds generated by Project Genie at I/O this week
Capabilities remain in early testing with expanded human-AI interaction methods.
#130Jeff Clune@JEFFCLUNEAwesome work, @ashrewards! I love seeing all the exciting new directions for Genie that you, @jparkerholder, and the rest of the team are exploring!
So cool to think back to those first Genie1 samples and now see the Cambrian explosion of ideas that resulted.
Ashley Edwards@ashrewardsLove seeing this out in the wild! We've been working on new ways for interacting with other players and agents with Genie. Still in early testing, but I'm so proud of the team for demoing this at I/O this week. Excited to see what this can enable in the future 🚀
#619Jack Parker-Holder@JPARKERHOLDERWe can now interact with Gemini in realtime inside Genie worlds 🤯 congrats to @ashrewards and team on this exciting new direction
Ian Stewart-Binks@binks_stewartProject Genie is magical... but we've also been working on some new ways to interact with another player (or agent). It was super fun to demo this new capability at Google I/O this week, where we enabled attendees to explore worlds with Gemini as a companion. Going forward, we are incredibly excited to see how this can enable Gemini to learn how to interact with humans in embodied environments. Some examples of interacting with Gemini in real-time within these generated worlds:
New MARL environments unlocked @j_foerst
Jack Parker-Holder@jparkerholderWe can now interact with Gemini in realtime inside Genie worlds 🤯 congrats to @ashrewards and team on this exciting new direction