Runway's GWM Worlds 2 is a General World Model that turns audio and video generation into an interactive simulation a user can play in real time, aimed at researchers, filmmakers, game designers, and robotics teams who need controllable synthetic environments. The model generates 720p video at 24 frames per second and 48 kHz audio, one step at a time , and it follows a "world prompt" split into a persistent scene with its subjects and rules plus a time-stamped event stream of text actions, with per-frame camera motion as a separate continuous input.
Under the hood, Runway fine-tunes its foundational audio-visual model on this world prompt format and then post-trains the bi-directional version into an auto-regressive one with no fixed duration, so sessions can continue indefinitely rather than producing fixed-length clips. Users can bind frequent actions to keys, address commands to the scene itself (flooding a room, rolling in a dust storm), start from a video instead of an image, and hand controls to agents that pursue objectives, with multiple people able to hold different roles in the same session.
The launch matters because it extends the direction Runway set with GWM-1, the autoregressive General World Model built on Gen-4.5 that runs in real time and can be controlled through camera pose, robot commands, and audio , pushing from short controllable clips toward open-ended playable worlds. Runway was founded in 2018 by Cristóbal Valenzuela, Alejandro Matamala, and Anastasis Germanidis , ITP alumni from NYU , and GWM Worlds 2 is the clearest signal yet of the company's move beyond video generation into simulation as a general-purpose interface.
Comments (15)
Sign in to join the discussion.
T
Tomasz BieleckiSep 3, 2026
720p at 24fps with real audio sync is cool and all, but I need to know how many H100s died to render this tweet.
D
Danylo MarchenkoSep 3, 2026
Any word on a public API or research paper drop, or is this a 'watch the sizzle reel and vibe' situation? Docs pls.
W
Wenqi L.Sep 3, 2026
The word 'interactive' is doing Olympic level gymnastics in this thread. Show me the input latency or it's just a fancy screensaver.
A
Ada OkaforSep 3, 2026
Building in adjacent territory and this raises the bar on audio-visual coupling. Respect, back to the mines for us.
B
Bruno SalcedoSep 3, 2026
That teaser cut hard on the beat drop at 0:11 and I felt personally attacked. Whoever edited this deserves a raise, not a bonus.
S
Sana QureshiSep 3, 2026
The teal to amber grade across the demo shots is beautiful but every 'world' looks like it was lit by the same DP. Diversify the color science.
P
Priyanka RamanSep 3, 2026
Simulating the world is neat but can it simulate a signed BAA and a SOC 2 Type II report by Q1? Asking for a very boring procurement team.
A
Annika SolbergSep 3, 2026
Every generative video lab is racing to simulate reality while the actual market for this outside of ad agencies is three people and a Discord.
F
Fatima NasserSep 3, 2026
Cool demo, but who is actually going to serve 24fps 720p interactive video to end users without their laptops taking off? Distribution is the whole game.
R
Rohan DeshpandeSep 3, 2026
This is genuinely the last world model that will ship without an agent loop wrapped around it. Next version pilots itself.
M
minh t.Sep 3, 2026
Third world-sim launch this month and the pacing is starting to feel like Marvel Phase 5. Which one am I supposed to remember?
E
Elif YıldırımSep 3, 2026
Happy to chat off the record about the training data pipeline whenever you have five minutes. I promise I'll spell everyone's name right this time.
J
Jae-hyun ParkSep 3, 2026
Meanwhile I'm two devs deep trying to get lipsync working in Premiere. The gap between us is Grand Canyon coded.
V
Valentin KuznetsovSep 3, 2026
I'll believe the 'real-time' claim when I see a live keyboard input session, not a Twitter compressed mp4. Pre-recorded interactivity is just a movie.
C
Chidera NwosuSep 3, 2026
If any of the diffusion infra folks on this team are quietly looking, I've got a candidate who did video codec work at a streaming shop. DMs open.
Work With Us
Book an intro call to explore our suite of services. We might have a waitlist.
Runway
Building AI to simulate the world.
Building AI to simulate the world.
Tags
TLVC Rating
Community Rating
No ratings yet
to rate this launch.
Runway's GWM Worlds 2 is a General World Model that turns audio and video generation into an interactive simulation a user can play in real time, aimed at researchers, filmmakers, game designers, and robotics teams who need controllable synthetic environments. The model generates 720p video at 24 frames per second and 48 kHz audio, one step at a time , and it follows a "world prompt" split into a persistent scene with its subjects and rules plus a time-stamped event stream of text actions, with per-frame camera motion as a separate continuous input. Under the hood, Runway fine-tunes its foundational audio-visual model on this world prompt format and then post-trains the bi-directional version into an auto-regressive one with no fixed duration, so sessions can continue indefinitely rather than producing fixed-length clips. Users can bind frequent actions to keys, address commands to the scene itself (flooding a room, rolling in a dust storm), start from a video instead of an image, and hand controls to agents that pursue objectives, with multiple people able to hold different roles in the same session. The launch matters because it extends the direction Runway set with GWM-1, the autoregressive General World Model built on Gen-4.5 that runs in real time and can be controlled through camera pose, robot commands, and audio , pushing from short controllable clips toward open-ended playable worlds. Runway was founded in 2018 by Cristóbal Valenzuela, Alejandro Matamala, and Anastasis Germanidis , ITP alumni from NYU , and GWM Worlds 2 is the clearest signal yet of the company's move beyond video generation into simulation as a general-purpose interface.
Comments (15)
720p at 24fps with real audio sync is cool and all, but I need to know how many H100s died to render this tweet.
Any word on a public API or research paper drop, or is this a 'watch the sizzle reel and vibe' situation? Docs pls.
The word 'interactive' is doing Olympic level gymnastics in this thread. Show me the input latency or it's just a fancy screensaver.
Building in adjacent territory and this raises the bar on audio-visual coupling. Respect, back to the mines for us.
That teaser cut hard on the beat drop at 0:11 and I felt personally attacked. Whoever edited this deserves a raise, not a bonus.
The teal to amber grade across the demo shots is beautiful but every 'world' looks like it was lit by the same DP. Diversify the color science.
Simulating the world is neat but can it simulate a signed BAA and a SOC 2 Type II report by Q1? Asking for a very boring procurement team.
Every generative video lab is racing to simulate reality while the actual market for this outside of ad agencies is three people and a Discord.
Cool demo, but who is actually going to serve 24fps 720p interactive video to end users without their laptops taking off? Distribution is the whole game.
This is genuinely the last world model that will ship without an agent loop wrapped around it. Next version pilots itself.
Third world-sim launch this month and the pacing is starting to feel like Marvel Phase 5. Which one am I supposed to remember?
Happy to chat off the record about the training data pipeline whenever you have five minutes. I promise I'll spell everyone's name right this time.
Meanwhile I'm two devs deep trying to get lipsync working in Premiere. The gap between us is Grand Canyon coded.
I'll believe the 'real-time' claim when I see a live keyboard input session, not a Twitter compressed mp4. Pre-recorded interactivity is just a movie.
If any of the diffusion infra folks on this team are quietly looking, I've got a candidate who did video codec work at a streaming shop. DMs open.