Gemini Omni generates realistic, first-person GoPro-style POV video from custom 3D camera trajectories
The workflow processes 3D reconstruction data using an MCMC strategy.
Edit key parts of a video just through conversation
A week ago, we released Gemini Omni, bringing nano banana editing to video!
Here, Omni was prompted to edit the view from the window to be iconic Oregon views aligned with my movements
There's so much Omni can do. 7 examples from the last 7 days in🧵
What else have you tried?
Better understand the details of an object by zooming in...
Omnizoom 🍜 diving into a photo with Gemini Omni
Change the point of view of a video
Gave omni a 3d camera trajectory and asked it to generate gopro style pov footage
...or by isolating the object and detailing it
Omnizoom 🍜 diving into a photo with Gemini Omni
Add a little something to a video :)
There's a new Release Notes podcast dropping soon, it'll be a really nice deep dive into Omni with the folks that helped make it. But also, I had far too much fun using Omni to make this preview.