Bilingual dictation assistant Silvia understands ‘Spanglish’ and other language mixtures

Date:

Share post:


Natural language AI assistants tend to be excellent English speakers, and passable in other tongues — but if you are one of the millions who fluidly switch between two languages on the fly, they’re stumped. A new AI helper called Silvia, however, understands “Spanglish” just fine, with more language combos to come.

The app — not a funded startup or anything like that — was created over the last month by Mansidak Singh, who during the day is a founding product engineer at re:collect AI.

“I met an Argentinian girl at a bar last month. During our conversation, she mentioned how her iPhone freaks out if you use a word in English while talking in Spanish,” Singh said. These assistants just aren’t flexible the way people’s brains are.

“For example, if you said, ‘Hey, vamos a cenar tonight? See you there!’ iOS would typically ignore the Spanish part if the English keyboard was enabled, or vice versa. This was not ideal for folks who speak in Spanglish. After talking to more folks in the LATAM community I realized this problem was more prevalent than I knew… so I solved it.”

Silvia is one of those little apps that pops up from the left side of your keyboard, so you just tap that instead of the native dictation icon. Then you’ll be able to speak in your favored mixture of languages, and it will type that right out for you. It supports only Spanish and English at first, but with French, Romanian, Ukrainian, German, and Dutch coming soon. There will also be a custom keyboard version so you can use it in non-Apple apps.

I asked whether we’d see a version for Hindi and English, another common mixture, but Singh said that, for now, the approach only works for Germanic languages that use the Roman alphabet.

Curious how he built it so quickly? Well, he’s already an engineer working in this space, of course, but really, the APIs are pretty strong here and he has deployed them cleverly.

“I’m currently using the new Translation API in iOS 18 to create two mono-channels for Spanish and English and then using OpenAI Whisper in parallel to do cleaning up, hence it works lightning fast,” he explained.

It doesn’t store any data, by the way, so don’t worry that this is some kind of shady play. It’s Apple-approved.

Unlike pretty much every other AI product out there, this one doesn’t claim to change the world — just reflect it a little more accurately. You’ll be able to download Silvia at the end of the month here, or sign up to get notified when it’s out if you’re forgetful, like me.



Source link

Lisa Holden
Lisa Holden
Lisa Holden is a news writer for LinkDaddy News. She writes health, sport, tech, and more. Some of her favorite topics include the latest trends in fitness and wellness, the best ways to use technology to improve your life, and the latest developments in medical research.

Recent posts

Related articles

OpenAI accidentally deleted potential evidence in NY Times copyright lawsuit (updated)

Lawyers for The New York Times and Daily News, which are suing OpenAI for allegedly scraping their...

Sequoia marks up its 2020 fund by 25%

Sequoia says no exits, no problem. The Silicon Valley titan of venture marked up the value of its...

Illumen Capital doubles down on supporting underrepresented funds

Illumen Capital is doubling down on its support for fund managers and founders from underrepresented communities.  The firm...

Gilroy, former Coatue fintech head, and angel investor Rajaram launch VC firm

Michael Gilroy, a former head of fintech investments at Coatue, and Gokul Rajaram, a longtime tech executive...

OpenAI is funding research into ‘AI morality’

OpenAI is funding academic research into algorithms that can predict humans’ moral judgements. In a filing with the...

Y Combinator often backs startups that duplicate other YC companies, data shows — it’s not just AI code editors

The Silicon Valley dream is to build a tech startup that is such a unique idea it...

Hyundai and Kia recall 208,000 EVs

Hyundai, Kia, and Genesis are recalling about 208,000 EVs in the United States due to an issue...

Money for tech that matters

Welcome to Startups Weekly — your weekly recap of everything you can’t miss from the world of startups. If you’d like to receive this...