• Home
  • Technology
  • Gaming
  • Entertainment
  • World & Business
  • Science
  • Sports
  • AI
HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
Gaming

GWM Worlds 2 Creates Interactive Worlds Without a Game Engine

Runway's GWM Worlds 2 generates interactive real-time 720p video and audio simulations that respond to user inputs.

RU
L✦
AP
10 Sources, 27d ago, first seen 27d ago

TLDR

Runway announced GWM Worlds 2, its latest General World Model. The system produces continuous interactive simulations as a single 720p video stream at 24 fps with 48000 Hz audio. It responds to arbitrary inputs while users explore environments, subjects, visual styles, physical rules, and ambience that they define. Runway co-founders and researchers stated the model merges navigation, manipulation, and human interaction in one general action space and runs without a separate game engine. They noted it is already in use to evaluate vision-language models on real-world tasks. Additional posts from the company showed further prompting examples.

Combined views

531.3K

10 Sources, first seen 27d ago

3.3K likes128 comments1.8K saves349 reposts

Combined views

531.3K

10 Sources, first seen 27d ago

3.3K likes128 comments1.8K saves349 reposts

Sentiment

Positive95.6%4.4%Negative

Summary

Many accounts praised RunwayML's GWM Worlds 2 for delivering impressive real-time interactive video-audio simulations, while a few questioned its ties to actual simulation or the launch timing.

Based on 51 sentiment-bearing replies from 45 accounts across 3 conversations.

Sentiment

Positive95.6%4.4%Negative

Summary

Many accounts praised RunwayML's GWM Worlds 2 for delivering impressive real-time interactive video-audio simulations, while a few questioned its ties to actual simulation or the launch timing.

Based on 51 sentiment-bearing replies from 45 accounts across 3 conversations.

10 Sources

@runwaymlToday, we're sharing new research on GWM Worlds 2. Our latest General World Model that generates interactive real-time simulations in continuous 720p video at 24 fps with 48000 Hz audio. Built on top of our foundational audio-visual generation model, GWM Worlds 2 allows you to define the environment, subjects, visual style, physical rules and ambience of any world. Once inside, you steer it with text actions addressed to any subject or to the scene itself, alongside continuous camera motion. The world continues from each new input instead of following a fixed clip or script so sessions have no preset length. GWM Worlds 2 creates a new foundation for interactive entertainment, virtual characters, robotics and embodied-agent simulation. Learn more about GWM Worlds 2 at the link below.
@LinusEkenstam@runwayml We are not ready for all these releases guys. Honestly september is not a loaded gun, it’s a warship full of updates.
@AdamPalmer28543No game engine behind this. GWM Worlds 2 is generating an intereactive world in real time and responding to every input as it happens.
@c_valenzuelabWe are sharing a major update to our General World Models efforts. GWM Worlds 2 can generate full, interactive, real-time video simulations in one continuous 720p stream at 24 fps and audio at 48000 Hz, responding to your inputs as you explore. It is the first world model that generalizes to arbitrary actions rather than a fixed set of actions or just navigation. Dynamic actions are what actually matter for building gaming and interactive experiences, and for training agents in these simulations. We also introduced WorldPrompt, a way to tell GWM-2 that a world can be split into two kinds of state: what persists and what changes over time. For example: persistent gravity, physics, and light, alongside actions that describe movement, gestures, object interactions, speech, and sound.
@ryanberckmansMy god. No doubt every game dev executive in the world is receiving this share today. Comfier in ETH than ever as eth being turbocharged by AI while AI can't possibly replace or compete with us. Public chains are in a sense the only digital thing AI won't be able to do.
@jongranskogOur latest world model is a joint video-audio model running in real-time with very expressive prompting. Really enjoyed working on this project!
@wolfejoshThis is truly so insane. We are big investors in @runwayml and even we had no idea their latest drops that are coming too fast to even keep up with. 🤯
@agermanidisAt the limit, world models will become the RL environments for everything. Excited to announce GWM Worlds 2, the first world model with a general action space, merging navigation, manipulation and human interaction in one model. We're already using it to evaluate vision-language models on real-world tasks. We're also working with game developers to prototype new kinds of interactive experiences, powered by a world-prompting format that lets you schedule player actions, dialogue, SFX and world events.
@andyorsowI use Runway for pretty much everything. Great UX. They are always cooking. They've been in the game longer than most. And they are not slimeballs. I however, am a slimeball so if you want 25% off a Runway plan you can use code: ORSOW25 You won't regret it!
    • HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
    • Home
    • Technology
    • Gaming
    • Entertainment
    • World & Business
    • Science
    • Sports
    • AI

    10 Sources

    @runwaymlToday, we're sharing new research on GWM Worlds 2. Our latest General World Model that generates interactive real-time simulations in continuous 720p video at 24 fps with 48000 Hz audio. Built on top of our foundational audio-visual generation model, GWM Worlds 2 allows you to define the environment, subjects, visual style, physical rules and ambience of any world. Once inside, you steer it with text actions addressed to any subject or to the scene itself, alongside continuous camera motion. The world continues from each new input instead of following a fixed clip or script so sessions have no preset length. GWM Worlds 2 creates a new foundation for interactive entertainment, virtual characters, robotics and embodied-agent simulation. Learn more about GWM Worlds 2 at the link below.
    @LinusEkenstam@runwayml We are not ready for all these releases guys. Honestly september is not a loaded gun, it’s a warship full of updates.
    @AdamPalmer28543No game engine behind this. GWM Worlds 2 is generating an intereactive world in real time and responding to every input as it happens.
    @c_valenzuelabWe are sharing a major update to our General World Models efforts. GWM Worlds 2 can generate full, interactive, real-time video simulations in one continuous 720p stream at 24 fps and audio at 48000 Hz, responding to your inputs as you explore. It is the first world model that generalizes to arbitrary actions rather than a fixed set of actions or just navigation. Dynamic actions are what actually matter for building gaming and interactive experiences, and for training agents in these simulations. We also introduced WorldPrompt, a way to tell GWM-2 that a world can be split into two kinds of state: what persists and what changes over time. For example: persistent gravity, physics, and light, alongside actions that describe movement, gestures, object interactions, speech, and sound.
    @ryanberckmansMy god. No doubt every game dev executive in the world is receiving this share today. Comfier in ETH than ever as eth being turbocharged by AI while AI can't possibly replace or compete with us. Public chains are in a sense the only digital thing AI won't be able to do.
    @jongranskogOur latest world model is a joint video-audio model running in real-time with very expressive prompting. Really enjoyed working on this project!
    @wolfejoshThis is truly so insane. We are big investors in @runwayml and even we had no idea their latest drops that are coming too fast to even keep up with. 🤯
    @agermanidisAt the limit, world models will become the RL environments for everything. Excited to announce GWM Worlds 2, the first world model with a general action space, merging navigation, manipulation and human interaction in one model. We're already using it to evaluate vision-language models on real-world tasks. We're also working with game developers to prototype new kinds of interactive experiences, powered by a world-prompting format that lets you schedule player actions, dialogue, SFX and world events.
    @andyorsowI use Runway for pretty much everything. Great UX. They are always cooking. They've been in the game longer than most. And they are not slimeballs. I however, am a slimeball so if you want 25% off a Runway plan you can use code: ORSOW25 You won't regret it!
    Today's Rank

    —

    Not ranked yet

    Today's Rank

    —

    Not ranked yet