Google DeepMind releases Omni, a video generation model that maintains consistent characters across scenes and supports iterative edits with physics simulation and Gemini knowledge
Omni generates reusable avatars from short clips retaining face and voice.
@venturetwins @GoogleDeepMind @shlomifruchter @nbrichtova Longer videos are coming! ;) thanks for playing with Omni, keep the feedback coming
Justine Moore@venturetwins@GoogleDeepMind That's it for now! I'm sure I'll be back with more generations later 😅 Huge congrats to @shlomifruchter, @doomie, @nbrichtova + the team on the launch. Really excited to see what folks do with "Nano Banana for video."
#274Jason Baldridge@JASONBALDRIDGEStop and eat the flowers
#761Lisha@LISHALI88@venturetwins @GoogleDeepMind Can’t wait for more historical day in life content from this
Justine Moore@venturetwins@GoogleDeepMind 1) Avatars Record a clip of yourself, and your face + voice will be saved as a character that you can add to any video. This makes it so easy to put yourself in any clip, while changing your style or outfit as needed to adapt to the scene. These clips are all my avatar 🤯
#849@levelsio@LEVELSIOAmazing work by Google once again 😍
Justine Moore@venturetwins@GoogleDeepMind 1) Avatars Record a clip of yourself, and your face + voice will be saved as a character that you can add to any video. This makes it so easy to put yourself in any clip, while changing your style or outfit as needed to adapt to the scene. These clips are all my avatar 🤯
@GoogleDeepMind 1) Avatars
Record a clip of yourself, and your face + voice will be saved as a character that you can add to any video.
This makes it so easy to put yourself in any clip, while changing your style or outfit as needed to adapt to the scene.
These clips are all my avatar 🤯
Justine Moore@venturetwinsOmni from @GoogleDeepMind just dropped 👀 It's a big step forward in video generation when it comes to character consistency, world knowledge, and editing. I've been testing it for the last few days - and I'm excited to walk through some of the key features + my clips 👇
2) World knowledge
Omni is grounded in Gemini's world knowledge - which means that it just knows a LOT of things without you having to include it in the prompt.
For example, upload an image of where you're standing and ask for a history or to explain a topic (like healing an ACL tear).
Justine Moore@venturetwins@GoogleDeepMind 1) Avatars Record a clip of yourself, and your face + voice will be saved as a character that you can add to any video. This makes it so easy to put yourself in any clip, while changing your style or outfit as needed to adapt to the scene. These clips are all my avatar 🤯
@bilawalsidhu brother... where art though, me and @mreflow are missing a friend 😂
Bilawal Sidhu@bilawalsidhuNano Banana for video is here! Google has long touted that Gemini is natively multi-modal in & out -- but Omni is the first glimpse into the power of that paradigm applied to creation. Toss in a video and do multi-turn edits. Toss in audio and get reactive visuals. It's kinda like talking to a smart VFX artist who can pull on it's world knowledge to inform your edits. Pretty impressive results! Could see Omni do well wrapped in a bigger authoring tool.
6/ Omni is rolling out today to Google AI Plus, Pro, Ultra subscribers globally through Gemini app + Google Flow.
Also coming at no cost to YouTube Shorts + YouTube Create this week.
API access in the coming weeks.
Alex Volkov@altryne5/ Think Nano Banana, but for video. Omni can edit conversationally: • change backgrounds • add cinematic zooms • modify action • add characters/objects • preserve character consistency • refine across turns without losing scene context
> Redo this video so that there is a new person every 1s (or 24 frames at 24fps). Rapid fire.
fofr@fofrAIHere's an example of 3 edits of a video with Omni: 1. original 2 maker her invisible, put gloves on her 3. while she's talking, two men come and take away the framed picture 4. change her outfit
There's a new Release Notes podcast dropping soon, it'll be a really nice deep dive into Omni with the folks that helped make it.
But also, I had far too much fun using Omni to make this preview.
Here's an example of 3 edits of a video with Omni:
1. original 2 maker her invisible, put gloves on her 3. while she's talking, two men come and take away the framed picture 4. change her outfit
