Spotify Using AI to Translate Podcasters' Original Voices to Additional Languages

Spotify this week announced an AI translation feature for podcasters that could give it an edge over Apple's podcasting platform. Voice Translation for podcasts uses artificial intelligence to translate podcasts into additional languages using the original podcaster's voice.

General Spotify Feature
While Spotify developed the tool, it is using OpenAI's latest voice generation technology. It learns the original speaker's voice and style and then translates the podcast into another language. Spotify says that this system will provide a "more authentic listening experience" that is more natural and personal than standard dubbing. Podcasts translated this way will retain the speaker's distinctive speech characteristics.

Spotify is testing Voice Translation at the current time, and is working with podcasters like Dax Shepard, Monica Padman, Bill Simmons, Steven Bartlett, and Lex Fridman to create AI-powered voice translations in languages like Spanish, French, and German for both existing episodes and future podcast episodes.

Voice-translated episodes are available worldwide to Premium and Free users. An initial bundle of translated episodes in Spanish are available now, with French and German rolling out "in the coming days and weeks." According to Spotify, the pilot program will provide "important insights" for future expansion and iteration.

While Apple does not have a competing tool at this time for the Podcasts platform, it is experimenting with AI voice technology. In iOS 17, Apple added a Personal Voice feature that allows you to use AI to create a replica of your voice. Right now, this is an accessibility feature that Apple has designed for those who are at risk of losing their ability to speak, but it stands to reason that Apple could use voice replication in other areas in the future.

Popular Stories

iPhone 17 Slim Feature Single Camera 1 Redux

'iPhone 17 Air' Launching Later This Year With These 10 New Features

Wednesday January 15, 2025 7:16 am PST by
While the so-called "iPhone 17 Air" is not expected to launch until September, there are already plenty of rumors about the "ultra-thin" device. Overall, the "iPhone 17 Air" is shaping up to be a mixed bag. Due to its thinness, the device is expected to have some limited specifications compared to the iPhone 17 Pro models, including only a single rear camera, only a single speaker, no SIM...
2024 iPhone Boxes Feature

Apple Changes Trade-In Values for iPhones, iPads, Macs, and More

Thursday January 16, 2025 6:45 am PST by
Apple today adjusted estimated trade-in values for select iPhone, iPad, Mac, and Apple Watch models in the U.S., according to its website. Some values increased, while others decreased. The changes were not too significant, with most values rising or dropping by $5 to $50. We have outlined some examples below: Device New Value Old Value iPhone 15 Pro Max Up to $630 U ...
Generic iOS 18

Everything New in iOS 18.3 Beta 3

Thursday January 16, 2025 12:39 pm PST by
Apple provided the third beta of iOS 18.3 to developers today, and while the betas have so far been light on new features, the third beta makes some major changes to Notification Summaries and also tweaks a few other features. Notification Summary Changes Apple made multiple changes to Notification Summaries in response to complaints about inaccurate summaries of news headlines. For...
new magsafe charger

Apple Releases Updated MagSafe Charger Firmware

Tuesday January 14, 2025 11:30 am PST by
Apple today released new firmware designed for the 25W MagSafe Charger that is compatible with the iPhone 12 and later and the latest AirPods and Apple Watch models. The updated firmware is version 2A143, up from the 2A138 firmware that the accessory shipped with. In the Settings app, you'll see a different version number than the internal firmware number. The 2024 MagSafe charger was...
iPhone 17 Pro Dual Tone Feature 1

iPhone 17 Pro Launching Later This Year With These 8 New Features

Thursday January 9, 2025 5:45 am PST by
While the iPhone 17 Pro and iPhone 17 Pro Max are not expected to launch until September, there are already plenty of rumors about the devices. iPhone 17 Pro concept based on rumors Below, we recap key changes rumored for the iPhone 17 Pro models as of January 2025: More aluminum: iPhone 17 Pro models are rumored to have an aluminum frame, whereas the iPhone 15 Pro and iPhone 16 Pro models ...
MacBook Air 15 Inch Feature Blue

MacBook Air Likely Apple's First Product Update of 2025: What to Expect

Wednesday January 15, 2025 8:49 am PST by
There is a good chance that Apple's first product announcement of 2025 will be updated 13-inch and 15-inch MacBook Air models with the M4 chip. Last month, Apple released macOS Sequoia 15.2, and in doing so it accidentally confirmed new MacBook Air models are coming this year (unsurprisingly). Bloomberg's Mark Gurman said the new MacBook Air models will be announced "earlier" than some...
Apple Card iPhone 16 Pro Feature

Three Companies Are Now in the Running to Take Over the Apple Card

Thursday January 16, 2025 8:18 am PST by
Apple is in talks with Barclays and Synchrony about becoming its new financial partner for the Apple Card, according to Reuters sources. The report today added that Apple has also been holding discussions with Chase Bank owner JPMorgan since last year, so there are at least three potential companies in the running to take over the Apple Card from current partner Goldman Sachs. Goldman...
Generic iOS 18

iOS 18.3 Coming Soon: Here's What's New

Monday January 13, 2025 5:33 am PST by
iOS 18.3 is currently in beta for developers and public beta testers. So far, the upcoming iPhone software update is very minor in scope. Below, we outline what is new in iOS 18.3 so far. The only potential new feature coming to iPhones with iOS 18.3 so far is robot vacuum support in the Home app, but this functionality is not yet live. Apple is laying the groundwork for the feature,...
apple power beats pro 2

Powerbeats Pro 2 Filed in Regulatory Databases Ahead of 2025 Launch

Wednesday January 15, 2025 6:02 am PST by
In September, Apple said that it would be launching Powerbeats Pro 2 in 2025, and now further evidence of the wireless earbuds has surfaced. Powerbeats Pro 2 images found in iOS 18 code Apple submitted Powerbeats Pro 2 regulatory documents to the U.S. Federal Communications Commission (FCC) in mid-December. The documents were made available to the public this week, and they were spotted by 91M...

Top Rated Comments

icanhazmac Avatar
17 months ago
No way I would ever allow another entity to "create" content in my voice. Before you know it you are getting canceled and apologizing for an AI error that caused "you" to say some horrific stuff in a language you don't even speak.
Score: 20 Votes (Like | Disagree)
NEPOBABY Avatar
17 months ago

I mean if it works reasonably well, why not? Wider audience and more revenue for the podcast.
There will definitely be many bad and messed up translations.

Relying on algorithms alone to translate languages is notoriously and famously difficult.

Anyone who has used YouTube or Instagram's translators knows how bad it is. Sometimes the meaning is changed completely.

Instagram translates my Chinese and Japanese friends posts wrong 50% of the time and converts their words into dumbed down American ghetto slang, which not only is a mistranslation but also paints people in a bad light.
Score: 14 Votes (Like | Disagree)
mrfunnypenguin Avatar
17 months ago
Have they completely forgot about HiFi?
Score: 6 Votes (Like | Disagree)
HobeSoundDarryl Avatar
17 months ago

I don’t see an issue with this. Everyone issue with AI (including mine) is lack of consent and getting payed for these AI companies stealing your work. If an artist agrees and is payed for their work getting used, I don’t see an issue.
Apple people see issues because this is a Spotify story. Take this one down, wait a day or two and put it back up as an Apple Podcasts story and we'll be gushing at Apple genius for the same thing. "We" are a very fair weather crowd. If it's an Apple innovation, it is genius. If it is an Apple competitor innovation, no one needs it, it's buggy as h*ll, it will never work right, security, privacy, risk of death/murder/mayhem/et all.

If it works pretty well, this seems great to me: great for Spotify, great for the podcasters, great for listeners who would like to hear some podcasts but in their own supported languages (even if there are some translation errors). Hopefully competition moves Apple to come up with the same or better ASAP. Competition is always good.
Score: 4 Votes (Like | Disagree)
zakarhino Avatar
17 months ago

any source about the android system implementation ?
None, I'm speculating this feature will be the next step up from the on device captions they already do. Apple added this last year or this year I think. Google have been doing it for years.

"All captions are processed locally, never stored, and never leave your device."

https://support.google.com/accessibility/android/answer/9350862?hl=en
Score: 3 Votes (Like | Disagree)
HobeSoundDarryl Avatar
17 months ago

I cannot stand watching movies where non native speakers do voiceovers. I much prefer subtitles.

Since Podcasts have overall not created growth for Spotify I presume that at some point they might drop them.
OK and OK. Apparently this has no benefit for you. Last I checked, there are other people in the world. Perhaps it's something THEY might appreciate while Spotify continues to offer them?
Score: 3 Votes (Like | Disagree)