So much fun presenting at SIGGRAPH with @yining_shi ! We showed how you can create a custom conversational character from just a single reference image. Once your character is created (~15 sec), you can talk with them in real-time (24fps). Runway Characters works with any style, from a photorealistic selfie to a cartoon brand mascot or an abstract creature. Links in thread for how to access Runway Characters in our webapp and API, plus our technical blog post.
Real-Time Live! is always one of SIGGRAPH’s most anticipated events, giving attendees a front-row seat to live demonstrations of the latest advances in computer graphics, AI, and interactive technology. Among this year’s memorable presentations was Runway’s Characters, where presenters Yining Shi and Kathleen Lewis introduced an expressive feline mascot to demonstrate how a single image can be transformed into a real-time conversational character, complete with natural expressions, lip-sync, and personality. 🐱✨
@yining_shi Our research and engineering blog post highlights more details about our model and how we optimize for speed: https://runwayml.com/news/engineering/building-runway-characters