Build a realtime translation app with the new Gemini Live Translate, Next.js, LiveKit and Cloud Run. What it covers:
1. Stream host audio via WebRTC to a LiveKit Room 2. Pipe PCM frames to Gemini Live for on-the-fly translation 3. Publish translated audio back as separate language tracks 4. Optimize latency with 100ms frame chunking (50Hz → 10Hz) 5. Deploy to Cloud Run with Secret Manager and auto-scaling
Links below ⤵️
Positive users praise the smooth flow of the realtime translation app tutorial with Gemini Live because it works effectively in testing.
No Digg Deeper questions have been answered for this story yet.
Blog: https://dev.to/googleai/build-a-realtime-translation-app-with-gemini-live-api-livekit-google-cloud-run-5474
Code: https://github.com/google-gemini/gemini-live-api-examples/tree/main/gemini-live-translate-livekit
Build a realtime translation app with the new Gemini Live Translate, Next.js, LiveKit and Cloud Run. What it covers:
1. Stream host audio via WebRTC to a LiveKit Room 2. Pipe PCM frames to Gemini Live for on-the-fly translation 3. Publish translated audio back as separate language tracks 4. Optimize latency with 100ms frame chunking (50Hz → 10Hz) 5. Deploy to Cloud Run with Secret Manager and auto-scaling
Links below ⤵️
@_philschmid Love the flow Philipp 😍
Works smooth in testing but for prod, how do you handle the trade-off between latency gains of 100ms chunking and like the potential loss of translation context/coherence when you scale this? 👀
