ElevenLabs’ voice-generating tools launch out of beta


Share post:

ElevenLabs, the viral AI-powered platform for creating synthetic voices, today launched its platform out of beta with support for more than 30 languages.

Using a new AI model developed in-house, ElevenLabs says that its tools are now capable of automatically identifying languages including Korean, Dutch and Vietnamese and generating “emotionally rich” speech in those languages.

In combination with the new model, ElevenLabs customers can leverage the platform’s voice cloning tool to speak across the almost 30 languages without first having to type text.

“ElevenLabs was started with the dream of making all content universally accessible in any language and in any voice,” ElevenLabs CEO and co-cofounder Mati Staniszewski said in a statement. “With this release, we’re one step closer to making this dream a reality and making human-quality AI voices available in every dialect. Our text-to-speech generation tools help level the playing field and bring top quality spoken audio capabilities to all the creators out there.”

Founded by Staniszewski, who previously worked at Palantir, and his childhood friend Piotr Dabkowski, an ex-Google employee, ElevenLabs has made headlines over the past few months for reasons both good and abhorrent. Inspired by the mediocre dubbing of American movies Staniszewski and Dabkowski watched growing up in Poland, the pair set about designing a platform that could do better — employing AI of course.

ElevenLabs launched in beta in late January, and picked up steam rather quickly — owing to the high quality of its generated voices and generous free tier. But as alluded to earlier, the publicity hasn’t been consistently positive — particularly once bad actors exploited the platform for their own ends.

The infamous message board 4chan, known for its conspiratorial content, used ElevenLabs’ tools to share hateful messages mimicking celebrities like actor Emma Watson. Elsewhere, The Verge’s James Vincent was able to tap ElevenLabs to clone targets’ voices in a matter of seconds, generating audio samples containing everything from threats of violence to expressions of racism and transphobia.

In response, ElevenLabs said that it would introduce a set of new safeguards, like limiting voice cloning to paid accounts and providing a new AI detection tool.

ElevenLabs has yet to grapple with the other controversy brewing around its platform and other platforms like it, though: their threat to the voice acting industry.

Motherboard writes about how voice actors are increasingly being asked to sign away rights to their voices so that clients can use AI to generate synthetic versions that could eventually replace them. Meanwhile, internal emails seen by The New York Times indicate that Activision Blizzard, one of the biggest game publishers in the world, is working on tools for AI-assisted “voice cloning.”

It would appear that ElevenLabs sees this as the natural progression of things, touting its work with publishers like Storytel; media platforms like TheSoul Publishing and MNTN for audiobooks and radio content; and publishers like Embark Studios and Paradox Interactive for video games, (Storytel and TheSoul Publishing are strategic investors.) The company claims that it has over a million registered users across the creative, entertainment and publishing spaces who’ve created ten years’ worth of audio content.

ElevenLabs, which recently raised $19 million from investors including Andreessen Horowitz and DeepMind co-founder Mustafa Suleyman at a $99 valuation, plans to eventually extend its AI models to voice dubbing — following in the footsteps of startups like Papercup and Deepdub and building what it calls “a foundation to be able to transfer emotions and intonation from one language to another.”

Beyond this, ElevenLabs says it plans to introduce a mechanism that’ll allow users to share voices on the platform, although the details remain hazy.

Source link

Lisa Holden
Lisa Holden
Lisa Holden is a news writer for LinkDaddy News. She writes health, sport, tech, and more. Some of her favorite topics include the latest trends in fitness and wellness, the best ways to use technology to improve your life, and the latest developments in medical research.

Recent posts

Related articles

New research: Vast majority of VC-backed UK startups do *nothing* on climate emissions

Some 76% of the top 500 VC-backed UK startups have done nothing to either measure or offset...

Google launches earthquake alerts on Android in India

Google has announced the launch of its earthquake alert system for Android devices in India. The system...

The writers strike is over; here’s how AI negotiations shook out

After almost five months, the Writers Guild of America (WGA) has reached an agreement with Hollywood studios...

Atlassian CTO: We were late moving to the cloud, on the ball with AI

“I’m responsible for all of engineering at Atlassian,” Rajeev Rajan said in our interview onstage at TechCrunch...

What is Amazon’s [redacted] ‘Project Nessie’ algorithm?

The FTC’s lawsuit against Amazon alleging anti-competitive practices is largely full of things we already knew in...

Sources: Palo Alto in advanced talks to buy Talon and Dig in a $1B security sweep

Palo Alto Networks’ stock price has been on the rise on the back of strong earnings and...

Talkdesk conducts third round of layoffs in less than 14 months

Talkdesk, a company once valued at $10 billion that sells software to help large corporations improve customer...

OpenAI is reportedly raising funds at a valuation of $80 billion to $90 billion

OpenAI is in discussions to possibly sell shares in a move that would boost the company’s valuation...