Recommended Free Tools
iTechGuides is reader-supported. When you buy through links on our site, we may earn an affiliate commission. As an Amazon Associate I earn from qualifying purchases. Learn more
WorldPrompt is Runway’s format for describing both a persistent generated world and the events that change it over time. In the September 2026 research preview, GWM Worlds 2 uses that format to generate audio and video continuously in response to timed text actions and camera input. It is a research preview—not a deterministic game engine—and Runway says it still has trade-offs in speed, visual fidelity, memory, and controllability.
What WorldPrompt represents
WorldPrompt separates a world’s enduring setup from what happens in it. That distinction lets a system receive scene context once, then process actions and camera movement as a session unfolds, rather than treating every request as an isolated prompt for a finished clip.
Persistent context: the world’s setup
The persistent context has two parts: a genesis prompt and a first frame. The genesis prompt can establish the scene’s layout, materials, lighting, and ambient sound; describe subjects and their attributes; and state reusable rules, or “laws,” such as gravity, collisions, character abilities, and camera perspective. The first frame grounds the description visually. These elements are described in Runway’s GWM Worlds 2 research preview, published September 3, 2026.
Event stream: what changes
The event stream contains free-form text actions with start and end times. An action can address a specific subject or the scene and describe movement, gestures, interactions with objects, speech, or sound. Events may overlap, so a conversation, a character’s movement, and a sound can be represented as concurrent actions. Camera input is separate: it is a per-frame stream of viewpoint translation and rotation.
#1 Best Overall
Runway’s street-corner example makes the distinction concrete. The genesis prompt sets a wet urban scene, two characters, and a camera-follow rule; timed events describe dialogue, leaves sweeping across the street, a character pointing, and someone walking. Speech is represented as an action in the same event format as movement.
How GWM Worlds 2 generates a continuing session
Runway describes GWM Worlds 2 as an autoregressive diffusion audio-video model. Its account of the process starts with fine-tuning a foundational audio-video generation model on WorldPrompt, then post-training it for autoregressive generation. In an autoregressive system, the model generates a frame or a small group of frames at a time, using prior output as context, rather than making an entire clip in one pass.
According to Runway’s model overview, each generation step is conditioned on the genesis prompt and first frame, current-frame text and camera input, and previously generated frames held in a sliding cache. Runway says the video and audio decoders are causal and cached to make decoding faster. The preview specifies continuous 720p video at 24 frames per second and audio at 48,000 Hz; these are Runway’s stated output specifications, not independent benchmark results.
In a September 25, 2026 Latent Space interview, Runway Principal Research Scientist Robin Kahlow described the pipeline as fine-tuning on WorldPrompt, post-training for autoregressive generation, and then using distillation methods to make generation real time. Runway co-founder and co-CEO Anastasis Germanidis described the autoregressive shift as producing a frame or a few frames at a time. These are explanations attributed to the interview, not independently verified implementation details.
Three ways to use the event stream
Runway describes three interaction patterns. They differ mainly in when actions are supplied and how much immediate response the experience needs.
| Mode | When actions are supplied | Examples Runway gives | Practical trade-off |
|---|---|---|---|
| Ahead-of-time | The event stream is authored before generation. | Filmmaking and advertising | Runway says this can produce better quality because the prompts can describe more of the scene. |
| Turn-based | Generation proceeds in segments, with user decisions between turns. | Visual novels and interactive film | Users can make decisions between generated segments rather than steering every moment continuously. |
| Continuous real time | The system generates while a user acts. | Games and interactive experiences | Immediate interaction requires low-latency control; Runway reports that this mode currently gives up some fidelity for speed. |
In Runway’s live demo, keys and mouse inputs are bound to prepared text prompts—for example, a movement action or throwing a ball—and mouse movement steers the camera. The controls therefore translate inputs into prompt actions; the demo is not evidence of a conventional game simulation with a structured internal state.
What “real-time world” does—and does not—mean
The format is a prompting and control surface for generated audio and video. It should not be mistaken for a conventional game engine that maintains explicit variables for positions, inventories, health, or quest state and applies deterministic rules to them. In the Latent Space interview, Kahlow says GWM Worlds 2 has no structured state: an agent observes generated video and audio. Runway’s preview also notes that an external harness may be needed to track state and produce actions, such as NPC dialogue.
Free tools Windows power users keep installed
One-click scans. No signup required.
That distinction matters when considering the applications Runway proposes: interactive entertainment, virtual characters, robotics and embodied-agent simulation, generative design, interfaces, and agent evaluation or training. These are possible uses presented in a research announcement, not proof that the preview is already a production-ready simulator for those areas. In the interview, CTO Kamil Sindi discusses synthetic data generation for agents; that is an attributed view about potential use, not an established evaluation result.
Independent reader supportYour contribution helps us test, update, and keep practical guides available for everyone.Current limitations and the quality trade-off
Runway identifies several constraints in the preview. They affect what a developer or creator can reasonably expect from continuous interaction:
- Speed versus fidelity: Runway says real-time generation currently trades visual fidelity for speed. Its preview warns that fast camera rotations can reduce detail, texture, and geometric consistency.
- Memory over time: Long-term memory is imperfect, so the generated world may not preserve every detail or event throughout an extended session.
- Limited image references: Image references are limited to the first frame, except for continuing from prefilled video or audio.
- Live prompts have less scene detail: Runway says ahead-of-time prompts currently produce better quality because they can describe more of the scene. During live play, the model must infer newly visible details from persistent context and previous frames.
- Open-ended control may need an external harness: For free-form interactions, a separate real-time system may need to track world state and generate actions, including dialogue.
The interview adds a related engineering concern: Germanidis calls error accumulation the biggest challenge with autoregressive models. As a model builds on its own generated frames, earlier imperfections can affect later output. Kahlow describes the broader challenge as generating incrementally while keeping the process fast enough for real-time use.
How this differs from Runway Game Worlds
Runway’s GWM Worlds 2 preview is distinct from its earlier Game Worlds announcement. The August 21, 2025 Runway Game Worlds announcement described a beta exploration of nonlinear narrative experiences, including preset worlds, user-created games, private-by-default custom worlds that could be made public, and Chat Mode and Comic Mode. It framed Game Worlds as an experience intended to evolve alongside General World Models. That earlier product context should not be treated as a description of the September 2026 GWM Worlds 2 research preview.
The Tool Desk
Outbyte PC Repair FREEClear out junk files and repair common Windows errorsFree Scan →Outbyte Driver Updater FREEScan for outdated or missing drivers - takes under a minuteDriver Scan →Quick Recap
Product prices and availability are accurate as of the date/time indicated and are subject to change. Any price and availability information displayed on Amazon at the time of purchase will apply.
