AI image and video generation company Runway has entered the competitive field of AI world models, launching its first iteration, GWM-1. This new model employs frame-by-frame prediction to create sophisticated simulations that understand physics and real-world behavior over time. The move positions Runway alongside a growing number of startups and major tech companies in the race to develop advanced AI simulations.

A world model is an artificial intelligence system designed to learn an internal simulation of how the physical world operates. This capability allows the AI to reason, plan, and act effectively without requiring extensive training on every conceivable real-life scenario.

Runway asserts that GWM-1 is more "general" than competing models like Google's Genie-3. The company, which recently saw its Gen 4.5 video model outperform Google and OpenAI on the Video Arena leaderboard, is positioning GWM-1 as a versatile tool for creating simulations to train AI agents across diverse fields, including robotics and life sciences.

Specialized World Model Applications

To cater to specific applications, Runway has introduced specialized versions of its world model: GWM-Worlds, GWM-Robotics, and GWM-Avatars.

GWM-Worlds

GWM-Worlds functions as an application for the model, enabling users to create interactive projects. By simply providing a prompt, users can define a scene, and as they navigate the virtual space, the model dynamically generates the world with an inherent understanding of geometry, physics, and lighting. While GWM-Worlds holds significant potential for gaming, Runway highlights its strong capability to train AI agents in navigating and interacting within physical environments.

GWM-Robotics

GWM-Robotics focuses on leveraging synthetic data, enhanced with parameters such as varying weather conditions and obstacles. Runway suggests this approach could be crucial for identifying instances where robots might deviate from their programmed policies and instructions in complex scenarios. Runway plans to release GWM-Robotics via an SDK and is currently in discussions with various robotics firms and enterprises regarding its adoption.

GWM-Avatars

Under GWM-Avatars, Runway is developing realistic avatars capable of simulating human behavior. This initiative aligns with efforts by other prominent companies, including D-ID, Synthesia, Soul Machines, and even Google, which are also focused on creating lifelike digital humans for applications in communication and training.

Gen 4.5 Video Model Update

In addition to its new world model, Runway has also rolled out a significant update to its foundational Gen 4.5 video model, initially launched earlier this month. This update introduces native audio and enhanced capabilities for long-form, multi-shot video generation. Runway states that users can now create one-minute videos featuring consistent characters, integrated dialogue, background audio, and intricate shots from multiple perspectives.

This Gen 4.5 enhancement positions Runway more competitively against rivals like Kling, whose all-in-one video suite also launched recently, particularly in areas of native audio and multi-shot narrative capabilities. The update underscores a broader industry trend: AI video generation models are rapidly evolving from experimental prototypes into robust, production-ready tools.

The updated Gen 4.5 model will first be accessible to enterprise customers, with a broader rollout to all paid plan users expected in the coming weeks.