Runway announces an API for its video-generating models

Date:

Share post:


Runway, one of several AI startups developing video-generating tech, today announced an API to allow devs and organizations to build the company’s generative AI models into third-party platforms, apps and services.

Currently in limited access (there’s a waitlist), the Runway API only offers a single model to choose from — Gen-3 Alpha Turbo, a faster but less capable version of Runway’s flagship, Gen-3 Alpha — and two plans, Build (which is aimed at individuals and teams) and Enterprise. Base pricing is one cent per credit (1 second of video costs 5 credits), and Runway says that “trusted strategic partners” including marketing group Omnicom are already using the API.

The Runway API also comes with unusual disclosure requirements. Any interfaces using the API must “prominently display” a “Powered by Runway” banner linking to Runway’s website, the company writes in a blog post, to “[help] users understand the technology behind [applications] while adhering to our usage terms.”

Runway, which is backed by investors including Salesforce, Google and Nvidia and was last valued at $1.5 billion, faces stiff competition in the video generation space, including from OpenAI, Google and Adobe. OpenAI is expected to release its video generation model, Sora, in some form this fall, while startups like Luma Labs continue to refine their technologies.

Image Credits: Runway

With the preliminary launch of the Runway API, Runway becomes one of the first AI vendors to offer a video generation model through an API. But while the API might help the company along the road to profitability (or at least recouping the high costs of training and running models), it won’t resolve the lingering legal questions around those models and generative AI technology more broadly.

Runway’s video-generating models, like all video-generating models, were trained on a vast number of examples of videos to “learn” the patterns in these videos to generate new footage. Where did the training data come from? Runway refuses to say, like many vendors these days — partly out of fear of losing competitive advantage.

But training details are also a potential source of IP-related lawsuits if Runway trained on copyrighted data without permission. There’s evidence that it did, in fact — a report from 404 Media in July exposed an internal spreadsheet of training data that included links to YouTube channels belonging to Netflix, Rockstar Games, Disney and creators like Linus Tech Tips and MKBHD.

It’s unclear whether Runway ended up sourcing any of the videos in the spreadsheet to train its models. In an interview with TechCrunch in June, Runway co-founder Anastasis Germanidis would only say the company uses “curated, internal datasets” for model training. But if it did, it wouldn’t be the only AI vendor playing fast and loose with copyright rules.

Earlier this year, OpenAI CTO Mira Murati didn’t outright deny that Sora was trained on YouTube content. And Nvidia reportedly used YouTube videos to train an internal video-generating model called Cosmos.

Generative AI vendors believe that the doctrine known as fair use provides them a legal shield. Others aren’t taking chances; to train its video-generating models, Adobe is said to be offering artists payments in exchange for clips. If we’re lucky, cases making their way through the courts will bring clarity soon enough.

However it shakes out, one thing’s becoming clear: Generative AI video tools threaten to upend the film and TV industry as we know it. A 2024 study commissioned by the Animation Guild, a union representing Hollywood animators and cartoonists, found that 75% of film production companies that have adopted AI have reduced, consolidated or eliminated jobs after incorporating the tech. The study also estimates that by 2026, more than 100,000 of U.S. entertainment jobs will be disrupted by generative AI.



Source link

Lisa Holden
Lisa Holden
Lisa Holden is a news writer for LinkDaddy News. She writes health, sport, tech, and more. Some of her favorite topics include the latest trends in fitness and wellness, the best ways to use technology to improve your life, and the latest developments in medical research.

Recent posts

Related articles

Ben Affleck tells actors and writers not to worry about AI

Unions representing Hollywood actors and writers went on strike last year to secure protections against AI systems...

Justice Department reportedly pushing Google to spin off Chrome

The Department of Justice is reportedly pushing to force Google to spin off its Chrome browser business. That’s...

TechCrunch Space: A big pivot

Hello, and welcome back to TechCrunch Space! This week, SpaceX President Gwynne Shotwell said she wouldn’t be...

Trump’s FCC pick has said he wants to ban TikTok, challenge Section 230

Though president-elect Donald Trump has been expected to stop the looming ban on TikTok, his political appointments...

OpenAI investor Josh Kushner praises Musk, despite Musk’s OpenAI lawsuit

Elon Musk may be suing OpenAI, accusing the ChatGPT maker of abandoning the company’s original mission as...

Mastodon sees a boost from the ‘X exodus,’ too, founder says

Decentralized social network Mastodon is also seeing some uplift from the X “exodus,” founder Eugen Rochko shared...

Healthcare VC firm Initiate has a new $45M and has already founded five startups internally

Jessica Owens and Iana Dimkova, co-founders of Initiate Ventures, are launching their new healthcare/ life sciences-focused firm...

Partiful is Google’s ‘best app’ of 2024

Partiful, the New York-based event-planning app that’s taking on older solutions like Evite, Eventbrite, and Facebook Events,...