Runway, the New York-based company AI video start, has released a major upgrade to its flagship Gen-2 text-to-video generator today. Improvements to video fidelity and consistency have led many in the AI creative community to call this release a big step forward for AI filmmaking.
The Gen-2 model was first released in March 2023, allowing users to enter text prompts to generate 4-second video clips. Previous versions required uploading an existing video. In August, Runway extended the maximum duration to 18 seconds.
The latest upgrade aims to improve the realism and sharpness of AI-generated videos. According to users, the resolution has been increased from 1792×1024 to 2816×1536. This allows for the creation of intricate details and smoother movement in simulated images.
Runway has also improved its “Director Mode” functionality introduced in September.
This allows camera movements like panning and zooming to be controlled to mimic cinematic techniques. Simulated camera movements are now more realistic and can be applied to specific objects or characters in a scene.
Creative professionals were stunned by the hyper-realistic results. Generative AI user TomLikesRobots called the upgrade is a “game changer” on social media. Early examples show AI human models with convincing facial expressions, detailed clothing and environments, and natural movements.
Although each clip is limited to 18 seconds, the artists have previously edited footage together to create narrative music videos and short films.
This is called “AI filmmaking”: the use of AI tools for production.
Runway founder Cristóbal Valenzuela said in an enthusiastic social media post job that “creation software is dead”. He explained that, unlike traditional software, AI generators create content independently rather than simply carrying out human instructions. The user plays the role of creative director rather than manually manipulating pixels.
The launch coincides with heated debates in Hollywood over AI-generated content that threatens actors’ careers. Although not intended for identity theft, Runway’s virtual human models exhibit increasing realism. This publication will undoubtedly intensify the discussion around the emerging role of AI in film and media production.
For now, the AI community seems unanimous in welcoming this technological step. As one user put it, this is a “pivotal moment in generative AI.” Only time will tell how society will adapt to these rapidly advancing creative AI systems that have the potential to fundamentally change the way movies are made.
Featured image credit: Viktoria Alipatova; Pixels; THANKS!