Runway released the powerful Gen-4 model for video generation

Runway has released the best video generator on the market — the Gen-4 model "breaks" Sora
Scene from the video generated by Runway Gen-4 AI. Photo: screenshot/Runway

Runway has released the Gen-4 model, which is able to generate videos with one of the highest levels of visual quality among competitors. It is already available for corporate clients and individual users of the Runway platform.

TechCrunch writes about it.

Advertisement

What the new model from Runway can do

The new Gen-4 model can generate stable images of characters, locations, and objects in different scenes without violating the integrity of the environment and reproducing individual elements from different positions and angles. Users can provide image models of a particular character and make a description of the shot or composition they would like to get.

"Gen-4 can utilize visual references, combined with instructions, to create new images and videos utilizing consistent styles, subjects, locations, and more, [a]ll without the need for fine-tuning or additional training," Runway claims in its blog.

The Gen-4 model can maintain the correspondence of characters in different lighting conditions, as well as simulate realistic physics in the frame. The developers of the model said that they trained the new tool on a significant amount of video material without disclosing the source of the data in order not to lose competitive advantage.

However, this approach of the company has already caused lawsuits. The class action lawsuit has already been filed against several companies, including Runway, for using copyrighted images without permission to train algorithms.

The startup itself is backed by investments from Salesforce, Nvidia, and Google and mainly specializes in video tools. The company's competitors are the giants OpenAI and Google with their Sora and Veo 2 models, respectively. Runway aims to maintain its position in the market, which is why it has already signed an agreement with a major Hollywood studio and invested heavily in the creation of films using AI.

As a reminder, ByteDance, which owns TikTok, has introduced the OmniHuman AI video generator. It can create realistic videos based on a single photo.

We also wrote that Google revealed the cost of using its new video generation tool Veo 2. Among all analogs, it is the most expensive to use.

video neural network AI
Advertisement
Advertisement
Advertisement
Advertisement