Runway’s world-model ambitions, from robotics to a neural operating system
Latent Space describes Runway’s bet that scaling video models may be enough to learn physics, while real-time generation could turn world models into robotics simulators.
TLDR
Latent Space says Runway’s co-founder and co-CEO views world models as the endgame for AI video, and describes how Sora triggered an existential sprint inside the company. His argument is that scaling video models may be enough to learn physics, while real-time generation could enable robotics simulators. He also sees a possible future in which software interfaces are generated directly as pixels rather than HTML and code, and says Runway is building toward a fully neural operating system.
