• Home
  • Technology
  • Gaming
  • Entertainment
  • World & Business
  • Science
  • Sports
  • AI
HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
    • HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
    • Home
    • Technology
    • Gaming
    • Entertainment
    • World & Business
    • Science
    • Sports
    • AI
    AI

    Runway Announces Research on GWM Worlds 2

    Official post highlights interactive simulation capabilities in 720p video with audio.

    CV
    JW
    GR
    15 Sources, 27d ago, first seen 27d ago

    TLDR

    Runway, the AI company behind generative video models, posted on X that it is sharing new research on GWM Worlds 2. The post presents this as the company's latest General World Model capable of producing interactive real-time simulations. These simulations appear in continuous 720p video running at 24 frames per second and include 48000 Hz audio. The model is built atop Runway's foundational audio-visual generation model. It permits users to define the environment, subjects, and visual elements according to the announcement. An attached video lasting 144 seconds was included with the tweet to demonstrate the output.

    Combined views

    531.9K

    15 Sources, first seen 27d ago

    Combined views

    531.9K

    15 Sources, first seen 27d ago

    3.3K likes
    3.3K likes
    130 comments
    1.8K saves
    363 reposts
    130 comments
    1.8K saves
    363 reposts

    Sentiment

    Positive94.1%5.9%Negative

    Summary

    Sentiment

    Positive94.1%5.9%Negative

    Many accounts welcomed RunwayML's GWM Worlds 2 for delivering impressive visuals and interactive real-time simulations, while a few dismissed it as meaningless tech unrelated to actual simulations.

    Based on 76 sentiment-bearing replies from 68 accounts across 6 conversations.

    Summary

    Many accounts welcomed RunwayML's GWM Worlds 2 for delivering impressive visuals and interactive real-time simulations, while a few dismissed it as meaningless tech unrelated to actual simulations.

    Based on 76 sentiment-bearing replies from 68 accounts across 6 conversations.

    Today's Rank

    —

    Not ranked yet

    Today's Rank

    —

    Not ranked yet

    15 Sources

    @runwaymlToday, we're sharing new research on GWM Worlds 2. Our latest General World Model that generates interactive real-time simulations in continuous 720p video at 24 fps with 48000 Hz audio. Built on top of our foundational audio-visual generation model, GWM Worlds 2 allows you to define the environment, subjects, visual style, physical rules and ambience of any world. Once inside, you steer it with text actions addressed to any subject or to the scene itself, alongside continuous camera motion. The world continues from each new input instead of following a fixed clip or script so sessions have no preset length. GWM Worlds 2 creates a new foundation for interactive entertainment, virtual characters, robotics and embodied-agent simulation. Learn more about GWM Worlds 2 at the link below.
    @c_valenzuelabWe are sharing a major update to our General World Models efforts. GWM Worlds 2 can generate full, interactive, real-time video simulations in one continuous 720p stream at 24 fps and audio at 48000 Hz, responding to your inputs as you explore. It is the first world model that generalizes to arbitrary actions rather than a fixed set of actions or just navigation. Dynamic actions are what actually matter for building gaming and interactive experiences, and for training agents in these simulations. We also introduced WorldPrompt, a way to tell GWM-2 that a world can be split into two kinds of state: what persists and what changes over time. For example: persistent gravity, physics, and light, alongside actions that describe movement, gestures, object interactions, speech, and sound.
    @kamilsindiSo proud of the team. Interactive world models will unlock a new form of storytelling: worlds born from human creativity, yet shaped by each person’s unique experience in the moment. Imagine the boundless possibilities of an open-world game combined with the singular, unrepeatable magic of live theater.
    @gokulrWow. GWM Worlds 2, first world model that generalizes to arbitrary actions. It allows you to define the environment, subjects, visual style, physical rules and ambience of any world. Once inside, you steer it with text actions addressed to any subject or to the scene itself, alongside continuous camera motion. Congrats @c_valenzuelab and @runwayml team on creating the next level world model for interactive entertainment, virtual characters, robotics and embodied-agent simulation.
    @graceisfordAnother very exciting launch for @runwayml with their GWM Worlds 2 model -- continuous, interactive, real time video simulations 🤯
    @genekoganThis is not just another video simulation with a WASD controller. The big new idea here is the WorldPrompt, which lets you program a live stream of text actions addressed to specific subjects or to the scene itself as it evolves, e.g. one player controls the protagonist, another the camera, another the weather or environment, etc. The interaction modalities are endless. Incredible work!
    @wolfejoshThis is truly so insane. We are big investors in @runwayml and even we had no idea their latest drops that are coming too fast to even keep up with. 🤯
    @agermanidisAt the limit, world models will become the RL environments for everything. Excited to announce GWM Worlds 2, the first world model with a general action space, merging navigation, manipulation and human interaction in one model. We're already using it to evaluate vision-language models on real-world tasks. We're also working with game developers to prototype new kinds of interactive experiences, powered by a world-prompting format that lets you schedule player actions, dialogue, SFX and world events.
    @thursdai_podA watermelon explodes from every angle. @runwayml's GWM Worlds 2 is here and it's shifting how we think about video generation. Professional-grade camera work, no specialized equipment. @altryne speechless. @LDJconfirmed breaks down why.

    15 Sources

    @runwaymlToday, we're sharing new research on GWM Worlds 2. Our latest General World Model that generates interactive real-time simulations in continuous 720p video at 24 fps with 48000 Hz audio. Built on top of our foundational audio-visual generation model, GWM Worlds 2 allows you to define the environment, subjects, visual style, physical rules and ambience of any world. Once inside, you steer it with text actions addressed to any subject or to the scene itself, alongside continuous camera motion. The world continues from each new input instead of following a fixed clip or script so sessions have no preset length. GWM Worlds 2 creates a new foundation for interactive entertainment, virtual characters, robotics and embodied-agent simulation. Learn more about GWM Worlds 2 at the link below.
    @c_valenzuelabWe are sharing a major update to our General World Models efforts. GWM Worlds 2 can generate full, interactive, real-time video simulations in one continuous 720p stream at 24 fps and audio at 48000 Hz, responding to your inputs as you explore. It is the first world model that generalizes to arbitrary actions rather than a fixed set of actions or just navigation. Dynamic actions are what actually matter for building gaming and interactive experiences, and for training agents in these simulations. We also introduced WorldPrompt, a way to tell GWM-2 that a world can be split into two kinds of state: what persists and what changes over time. For example: persistent gravity, physics, and light, alongside actions that describe movement, gestures, object interactions, speech, and sound.
    @kamilsindiSo proud of the team. Interactive world models will unlock a new form of storytelling: worlds born from human creativity, yet shaped by each person’s unique experience in the moment. Imagine the boundless possibilities of an open-world game combined with the singular, unrepeatable magic of live theater.
    @gokulrWow. GWM Worlds 2, first world model that generalizes to arbitrary actions. It allows you to define the environment, subjects, visual style, physical rules and ambience of any world. Once inside, you steer it with text actions addressed to any subject or to the scene itself, alongside continuous camera motion. Congrats @c_valenzuelab and @runwayml team on creating the next level world model for interactive entertainment, virtual characters, robotics and embodied-agent simulation.
    @graceisfordAnother very exciting launch for @runwayml with their GWM Worlds 2 model -- continuous, interactive, real time video simulations 🤯
    @genekoganThis is not just another video simulation with a WASD controller. The big new idea here is the WorldPrompt, which lets you program a live stream of text actions addressed to specific subjects or to the scene itself as it evolves, e.g. one player controls the protagonist, another the camera, another the weather or environment, etc. The interaction modalities are endless. Incredible work!
    @wolfejoshThis is truly so insane. We are big investors in @runwayml and even we had no idea their latest drops that are coming too fast to even keep up with. 🤯
    @agermanidisAt the limit, world models will become the RL environments for everything. Excited to announce GWM Worlds 2, the first world model with a general action space, merging navigation, manipulation and human interaction in one model. We're already using it to evaluate vision-language models on real-world tasks. We're also working with game developers to prototype new kinds of interactive experiences, powered by a world-prompting format that lets you schedule player actions, dialogue, SFX and world events.
    @thursdai_podA watermelon explodes from every angle. @runwayml's GWM Worlds 2 is here and it's shifting how we think about video generation. Professional-grade camera work, no specialized equipment. @altryne speechless. @LDJconfirmed breaks down why.