Spotify Using AI to Translate Podcasters' Original Voices to Additional Languages

Spotify this week announced an AI translation feature for podcasters that could give it an edge over Apple's podcasting platform. Voice Translation for podcasts uses artificial intelligence to translate podcasts into additional languages using the original podcaster's voice.

General Spotify Feature
While Spotify developed the tool, it is using OpenAI's latest voice generation technology. It learns the original speaker's voice and style and then translates the podcast into another language. Spotify says that this system will provide a "more authentic listening experience" that is more natural and personal than standard dubbing. Podcasts translated this way will retain the speaker's distinctive speech characteristics.

Spotify is testing Voice Translation at the current time, and is working with podcasters like Dax Shepard, Monica Padman, Bill Simmons, Steven Bartlett, and Lex Fridman to create AI-powered voice translations in languages like Spanish, French, and German for both existing episodes and future podcast episodes.

Voice-translated episodes are available worldwide to Premium and Free users. An initial bundle of translated episodes in Spanish are available now, with French and German rolling out "in the coming days and weeks." According to Spotify, the pilot program will provide "important insights" for future expansion and iteration.

While Apple does not have a competing tool at this time for the Podcasts platform, it is experimenting with AI voice technology. In iOS 17, Apple added a Personal Voice feature that allows you to use AI to create a replica of your voice. Right now, this is an accessibility feature that Apple has designed for those who are at risk of losing their ability to speak, but it stands to reason that Apple could use voice replication in other areas in the future.

Popular Stories

iPhone 17 Plus Feature

iPhone 17 Lineup Specs Detail Display Upgrade and New High-End Model

Monday July 22, 2024 4:33 am PDT by
Key details about the overall specifications of the iPhone 17 lineup have been shared by the leaker known as "Ice Universe," clarifying several important aspects of next year's devices. Reports in recent months have converged in agreement that Apple will discontinue the "Plus" iPhone model in 2025 while introducing an all-new iPhone 17 "Slim" model as an even more high-end option sitting...
iPhone SE 4 Vertical Camera Feature

iPhone SE 4 Production Will Reportedly Begin Ramping Up in October

Tuesday July 23, 2024 2:00 pm PDT by
Following nearly two years of rumors about a fourth-generation iPhone SE, The Information today reported that Apple suppliers are finally planning to begin ramping up mass production of the device in October of this year. If accurate, that timeframe would mean that the next iPhone SE would not be announced alongside the iPhone 16 series in September, as expected. Instead, the report...
iPhone 17 Plus Feature Purple

These 5 Features Will Make the iPhone 17 the Biggest Update in Years

Monday July 22, 2024 4:02 pm PDT by
The upcoming iPhone 16 models that we're expecting to see in September are going to be quite similar to the iPhone 15 models, but rumors suggest that Apple is making big changes in 2025. We've been hearing hints of an all-new device in the iPhone lineup, and it may be the most expensive iPhone Apple has offered to date. New 'Slim' Design Rumors have taken to referring to the new iPhone 17...
Generic iPhone 17 Feature With Full Width Dynamic Island

Kuo: Ultra-Thin iPhone 17 to Feature A19 Chip, Single Rear Camera, Semi-Titanium Frame, and More

Wednesday July 24, 2024 9:06 am PDT by
Apple supply chain analyst Ming-Chi Kuo today shared alleged specifications for a new ultra-thin iPhone 17 model rumored to launch next year. Kuo expects the device to be equipped with a 6.6-inch display with a current-size Dynamic Island, a standard A19 chip rather than an A19 Pro chip, a single rear camera, and an Apple-designed 5G chip. He also expects the device to have a...
iOS 18 on iPhone Feature

Everything New in iOS 18 Beta 4

Tuesday July 23, 2024 1:08 pm PDT by
Apple released the fourth beta of iOS 18 today, introducing small changes to a number of features throughout the operating system. There are no big additions in this beta, but Apple is continuing to refine existing settings and design choices. Apple plans to continue updating iOS 18 over the next few months, with the update set to be released this fall. We've rounded up all of the changes...
iPhone SE 4 Thumb 1

iPhone SE 4 Rumored to Launch Early Next Year With OLED Display, 48MP Camera, and More

Monday July 22, 2024 7:22 am PDT by
The fourth-generation iPhone SE will offer a series of major upgrades over the current model, the leaker known as "Ice Universe" claims. The information was listed in a post on Weibo, which also detailed the specifications of the iPhone 17 lineup. As previously rumored, the fourth-generation iPhone SE is expected to feature Face ID and USB-C, marking a major upgrade from current and previous ...
iPhone 17 Plus Feature Purple

iPhone 17 Rumored to Feature Mechanical Aperture

Tuesday July 23, 2024 9:32 am PDT by
Apple is planning to release at least one iPhone 17 model next year with mechanical aperture, according to a report published today by The Information. The mechanical system would allow users to adjust the size of the iPhone 17's aperture, which refers to the opening of the camera lens through which light enters. All existing iPhone camera lenses have fixed apertures, but some Android...
iPhone 15 Pro Lineup Feature White

Internal Change to iPhone 16 Models Expected to Reduce Overheating

Tuesday July 23, 2024 3:00 pm PDT by
Shortly after the iPhone 15 Pro and iPhone 15 Pro Max were released last September, some customers began to experience an issue with the devices overheating. Apple eventually mitigated the problem with an iOS 17 update, but it might go a step further with the iPhone 16 models that are set to be released later this year. The Information today cited a source who said that iPhone 16 models will ...

Top Rated Comments

icanhazmac Avatar
11 months ago
No way I would ever allow another entity to "create" content in my voice. Before you know it you are getting canceled and apologizing for an AI error that caused "you" to say some horrific stuff in a language you don't even speak.
Score: 20 Votes (Like | Disagree)
NEPOBABY Avatar
11 months ago

I mean if it works reasonably well, why not? Wider audience and more revenue for the podcast.
There will definitely be many bad and messed up translations.

Relying on algorithms alone to translate languages is notoriously and famously difficult.

Anyone who has used YouTube or Instagram's translators knows how bad it is. Sometimes the meaning is changed completely.

Instagram translates my Chinese and Japanese friends posts wrong 50% of the time and converts their words into dumbed down American ghetto slang, which not only is a mistranslation but also paints people in a bad light.
Score: 14 Votes (Like | Disagree)
mrfunnypenguin Avatar
11 months ago
Have they completely forgot about HiFi?
Score: 6 Votes (Like | Disagree)
HobeSoundDarryl Avatar
11 months ago

I don’t see an issue with this. Everyone issue with AI (including mine) is lack of consent and getting payed for these AI companies stealing your work. If an artist agrees and is payed for their work getting used, I don’t see an issue.
Apple people see issues because this is a Spotify story. Take this one down, wait a day or two and put it back up as an Apple Podcasts story and we'll be gushing at Apple genius for the same thing. "We" are a very fair weather crowd. If it's an Apple innovation, it is genius. If it is an Apple competitor innovation, no one needs it, it's buggy as h*ll, it will never work right, security, privacy, risk of death/murder/mayhem/et all.

If it works pretty well, this seems great to me: great for Spotify, great for the podcasters, great for listeners who would like to hear some podcasts but in their own supported languages (even if there are some translation errors). Hopefully competition moves Apple to come up with the same or better ASAP. Competition is always good.
Score: 4 Votes (Like | Disagree)
zakarhino Avatar
11 months ago

any source about the android system implementation ?
None, I'm speculating this feature will be the next step up from the on device captions they already do. Apple added this last year or this year I think. Google have been doing it for years.

"All captions are processed locally, never stored, and never leave your device."

https://support.google.com/accessibility/android/answer/9350862?hl=en
Score: 3 Votes (Like | Disagree)
HobeSoundDarryl Avatar
11 months ago

I cannot stand watching movies where non native speakers do voiceovers. I much prefer subtitles.

Since Podcasts have overall not created growth for Spotify I presume that at some point they might drop them.
OK and OK. Apparently this has no benefit for you. Last I checked, there are other people in the world. Perhaps it's something THEY might appreciate while Spotify continues to offer them?
Score: 3 Votes (Like | Disagree)