Spotify Using AI to Translate Podcasters' Original Voices to Additional Languages

Spotify this week announced an AI translation feature for podcasters that could give it an edge over Apple's podcasting platform. Voice Translation for podcasts uses artificial intelligence to translate podcasts into additional languages using the original podcaster's voice.

General Spotify Feature
While Spotify developed the tool, it is using OpenAI's latest voice generation technology. It learns the original speaker's voice and style and then translates the podcast into another language. Spotify says that this system will provide a "more authentic listening experience" that is more natural and personal than standard dubbing. Podcasts translated this way will retain the speaker's distinctive speech characteristics.

Spotify is testing Voice Translation at the current time, and is working with podcasters like Dax Shepard, Monica Padman, Bill Simmons, Steven Bartlett, and Lex Fridman to create AI-powered voice translations in languages like Spanish, French, and German for both existing episodes and future podcast episodes.

Voice-translated episodes are available worldwide to Premium and Free users. An initial bundle of translated episodes in Spanish are available now, with French and German rolling out "in the coming days and weeks." According to Spotify, the pilot program will provide "important insights" for future expansion and iteration.

While Apple does not have a competing tool at this time for the Podcasts platform, it is experimenting with AI voice technology. In iOS 17, Apple added a Personal Voice feature that allows you to use AI to create a replica of your voice. Right now, this is an accessibility feature that Apple has designed for those who are at risk of losing their ability to speak, but it stands to reason that Apple could use voice replication in other areas in the future.

Top Rated Comments

icanhazmac Avatar
10 weeks ago
No way I would ever allow another entity to "create" content in my voice. Before you know it you are getting canceled and apologizing for an AI error that caused "you" to say some horrific stuff in a language you don't even speak.
Score: 20 Votes (Like | Disagree)
NEPOBABY Avatar
10 weeks ago

I mean if it works reasonably well, why not? Wider audience and more revenue for the podcast.
There will definitely be many bad and messed up translations.

Relying on algorithms alone to translate languages is notoriously and famously difficult.

Anyone who has used YouTube or Instagram's translators knows how bad it is. Sometimes the meaning is changed completely.

Instagram translates my Chinese and Japanese friends posts wrong 50% of the time and converts their words into dumbed down American ghetto slang, which not only is a mistranslation but also paints people in a bad light.
Score: 14 Votes (Like | Disagree)
mrfunnypenguin Avatar
10 weeks ago
Have they completely forgot about HiFi?
Score: 6 Votes (Like | Disagree)
HobeSoundDarryl Avatar
10 weeks ago

I don’t see an issue with this. Everyone issue with AI (including mine) is lack of consent and getting payed for these AI companies stealing your work. If an artist agrees and is payed for their work getting used, I don’t see an issue.
Apple people see issues because this is a Spotify story. Take this one down, wait a day or two and put it back up as an Apple Podcasts story and we'll be gushing at Apple genius for the same thing. "We" are a very fair weather crowd. If it's an Apple innovation, it is genius. If it is an Apple competitor innovation, no one needs it, it's buggy as h*ll, it will never work right, security, privacy, risk of death/murder/mayhem/et all.

If it works pretty well, this seems great to me: great for Spotify, great for the podcasters, great for listeners who would like to hear some podcasts but in their own supported languages (even if there are some translation errors). Hopefully competition moves Apple to come up with the same or better ASAP. Competition is always good.
Score: 4 Votes (Like | Disagree)
zakarhino Avatar
10 weeks ago

any source about the android system implementation ?
None, I'm speculating this feature will be the next step up from the on device captions they already do. Apple added this last year or this year I think. Google have been doing it for years.

"All captions are processed locally, never stored, and never leave your device."

https://support.google.com/accessibility/android/answer/9350862?hl=en
Score: 3 Votes (Like | Disagree)
HobeSoundDarryl Avatar
10 weeks ago

I cannot stand watching movies where non native speakers do voiceovers. I much prefer subtitles.

Since Podcasts have overall not created growth for Spotify I presume that at some point they might drop them.
OK and OK. Apparently this has no benefit for you. Last I checked, there are other people in the world. Perhaps it's something THEY might appreciate while Spotify continues to offer them?
Score: 3 Votes (Like | Disagree)

Popular Stories

iOS 17

iOS 17.2 Will Add These 12 New Features to Your iPhone

Friday December 1, 2023 12:19 pm PST by
iOS 17.2 has been in beta testing for over a month, and it should be released to all users in a few more weeks. The software update includes many new features and changes for iPhones, including the dozen that we have highlighted below. iOS 17.2 is expected to be released to the public in mid-December. To learn about even more features coming in the update, check out our full list. Journal ...
iOS 17

28 New Things Your iPhone Can Do in December's iOS 17.2 Update

Friday December 1, 2023 2:57 am PST by
Apple made the first beta of iOS 17.2 available to developers in October. Since then we've seen three more betas, and with each iteration Apple continues to add more new features and changes, many of which users have been anticipating for quite a while. Below, we've listed 28 new things that are coming to your iPhone when the finalized version is publicly released this December. 1. Help...
anker new xmas 1

Anker's Cyber Week Sale Enters Final Days With Up to 60% Off Sitewide

Friday December 1, 2023 12:05 pm PST by
Anker's Black Friday/Cyber Week event is entering its final days this weekend, and it's still offering up to 60 percent off sitewide. There are also a few "mystery boxes" that can include hundreds of dollars in savings, if you're willing to risk not knowing what you're buying ahead of time. All of these sales will end on December 3. Note: MacRumors is an affiliate partner with Anker. When you...
iOS 17

Apple Releases iOS 17.1.2 With Security Fixes

Thursday November 30, 2023 10:12 am PST by
Apple today released iOS 17.1.2 and iPadOS 17.1.2, small updates to the iOS 17 and iPadOS 17 operating systems that Apple introduced in September. iOS 17.1.2 and iPadOS 17.1.2 come a few weeks after the release of iOS 17.1.1, another bug fix update. iOS 17.1.2 and iPadOS 17.1.2 can be downloaded on eligible iPhones and iPads over-the-air by going to Settings > General > Software Update....
iPhone 16 Mock Header Updated 1

iPhone 16 to Include Action Button Across Entire Lineup

Thursday November 30, 2023 4:08 pm PST by
The release of the iPhone 15 Pro and Pro Max saw the introduction of an entirely new user-configurable button known as the Action button, and now, MacRumors has seen extensive evidence confirming Apple is planning to include the Action button on the entire iPhone 16 range. Designs and plans for the Action button date back to at least 2021, as the button was intended for release alongside hapt...
General Apps Messages

Green Bubbles on iPhone to Gain These 7 New Features Next Year

Thursday November 30, 2023 9:00 am PST by
Earlier this month, Apple announced that it will finally support RCS in the Messages app on the iPhone starting later next year. This change will result in several improvements to the messaging experience between iPhones and Android devices. RCS will become the new default standard for messaging between iPhones and Android devices, but these conversations will still have green bubbles like...
top stories 2dec2023

Top Stories: iOS 17.1.2 Released, NameDrop Misinformation, and More

Saturday December 2, 2023 6:00 am PST by
Apple employees are back to work following a Thanksgiving break, and that means this week saw a number of new operating system updates for both public release and beta testing. This week also saw some misinformation about Apple's new NameDrop feature making the rounds, while Apple and Goldman Sachs appear to be on the verge of a break-up in their Apple Card and savings account partnership,...
paramount plus logo

Apple and Paramount Considering Discounted TV+ Streaming Bundle

Friday December 1, 2023 4:40 am PST by
Apple and Paramount have discussed bundling their TV streaming services at a discount, according to a new report by The Wall Street Journal. The companies have talked about offering a combination of Paramount+ and Apple TV+ that would cost less than subscribing to both services separately, according to people familiar with the discussions. The discussions are in their early stages, and it is ...