Google Gemini Gains Smarter Video Processing with Agentic Understanding
Official posts describe dynamic selection of frames, audio, and transcripts for long video analysis.
Google and DeepMind accounts announced agentic video understanding for the latest Gemini models. Instead of fixed frame rates, the models reason over transcripts, audio, and selected frames to handle long videos. The posts state this approach improves accuracy while cutting token use and costs. The feature is available now through the Gemini API in AI Studio and the Enterprise Agent Platform. It is scheduled to reach the Gemini app and YouTube's Ask YouTube feature later.
We’re bringing agentic video understanding to our latest Gemini models. They can now analyze videos with better accuracy while using up to 88% fewer tokens. 🧵
Google Gemini Gains Smarter Video Processing with Agentic Understanding
Official posts describe dynamic selection of frames, audio, and transcripts for long video analysis.
Reactions
12 postsGD 
Google DeepMind@GoogleDeepMindInstead of scanning an entire file, Gemini reasons across the video’s transcript, audio, and frames, dynamically adjusting the frame rate to pull the exact moments needed. The efficiency gains are most significant for long-form content, from 10-minute guides to multi-hour…
- likes: 153
- replies: 16
- bookmarks: 28
- reposts: 3
GO Google@GoogleWe’re introducing a new capability to our latest Gemini models: agentic video understanding. This allows developers to process long-form video content with more accuracy, while using up to 88% less tokens. See how it works 🧵
- likes: 5.5K
- replies: 193
- bookmarks: 2.4K
- reposts: 462
GO Google@GoogleWith agentic video understanding, developers can dynamically search, scan, and inspect long-form video with up to: 📉 88% fewer tokens 📉 66% lower cost ✅ 7% better accuracy
- likes: 228
- replies: 6
- bookmarks: 27
- reposts: 10
GO Google@GoogleAgentic video understanding is available now across our latest models via the Gemini API in @GoogleAIStudio and the Gemini Enterprise Agent Platform. Coming soon to the @GeminiApp and to @YouTube's “Ask YouTube” feature on the video watch page. Learn more ↓…
- likes: 226
- replies: 8
- bookmarks: 101
- reposts: 14
PS Philipp Schmid@_philschmidGemini video understanding is now agentic. Gemini can now iteratively navigate video timelines, decide watch what, pick frame rates, or chooses whether it needs speech transcripts, audio, or visual frames to answer your prompt. Result: Long videos get up to 88% fewer tokens and…
- likes: 266
- replies: 11
- bookmarks: 126
- reposts: 13
LK Logan Kilpatrick@OfficialLoganKIntroducing Agentic Video in the Gemini API, a new way to process long videos which reduces token consumption by up to 88% while also increasing quality. This can be controlled easily in the API on a per video basis, available with our newest models like 3.7 Flash!
- likes: 2.3K
- replies: 120
- bookmarks: 558
- reposts: 119