Spotify Using AI to Translate Podcasters' Original Voices to Additional Languages

Spotify this week announced an AI translation feature for podcasters that could give it an edge over Apple's podcasting platform. Voice Translation for podcasts uses artificial intelligence to translate podcasts into additional languages using the original podcaster's voice.

General Spotify Feature
While Spotify developed the tool, it is using OpenAI's latest voice generation technology. It learns the original speaker's voice and style and then translates the podcast into another language. Spotify says that this system will provide a "more authentic listening experience" that is more natural and personal than standard dubbing. Podcasts translated this way will retain the speaker's distinctive speech characteristics.

Spotify is testing Voice Translation at the current time, and is working with podcasters like Dax Shepard, Monica Padman, Bill Simmons, Steven Bartlett, and Lex Fridman to create AI-powered voice translations in languages like Spanish, French, and German for both existing episodes and future podcast episodes.

Voice-translated episodes are available worldwide to Premium and Free users. An initial bundle of translated episodes in Spanish are available now, with French and German rolling out "in the coming days and weeks." According to Spotify, the pilot program will provide "important insights" for future expansion and iteration.

While Apple does not have a competing tool at this time for the Podcasts platform, it is experimenting with AI voice technology. In iOS 17, Apple added a Personal Voice feature that allows you to use AI to create a replica of your voice. Right now, this is an accessibility feature that Apple has designed for those who are at risk of losing their ability to speak, but it stands to reason that Apple could use voice replication in other areas in the future.

Popular Stories

Generic iOS 18

Apple Releases iOS 18.0.1 With Touch Screen Bug Fix and More

Thursday October 3, 2024 2:22 pm PDT by
Apple today released iOS 18.0.1 and iPadOS 18.0.1, the first updates to the iOS 18 and iPadOS 18 operating systems that debuted earlier in September. iOS 18.0.1 and iPadOS 18.0.1 come two weeks after the launch of iOS 18. The new software can be downloaded on eligible iPhones and iPads over-the-air by going to Settings > General > Software Update. According to Apple's release notes, the...
15 New Things Your iPhone Can Do in iOS 18

15 New Things Your iPhone Can Do in iOS 18.1

Friday September 27, 2024 6:14 am PDT by
Apple is set to release iOS 18.1 in October, bringing the first set of Apple Intelligence features to iPhone 15 Pro and iPhone 16 models. This update marks a significant step forward in Apple's AI integration, offering a new Siri contextually-aware experience and a range of additional capabilities powered by on-device machine learning and large language models. There are a couple of handy new...
ipad mini 2021 youtube

New Report Reveals When to Expect the iPad Mini 7

Tuesday October 1, 2024 2:09 pm PDT by
Apple is working on a new iPad mini that will "potentially" be released "by the end of 2024," according to a report today from Bloomberg's Mark Gurman. Last month, Gurman reported that Apple had "new iPads in the works," including an upgraded version of the iPad mini. At the time, he said the device was "on deck for Apple's October event" alongside the first M4 Macs. The wording in his...
macOS Sequoia Night Feature

Apple Releases macOS Sequoia 15.0.1 With Bug Fixes

Thursday October 3, 2024 2:27 pm PDT by
Apple today released macOS Sequoia 15.0.1, the first update for the macOS Sequoia operating system. The 15.0.1 update comes a week after Apple first released macOS Sequoia 15. Mac users can download the ‌macOS Sequoia‌ update by using the Software Update section of System Settings. According to Apple's release notes, macOS Sequoia 15.0.1 fixes a bug that could cause the Messages app...
maxresdefault

Two Weeks With the iPhone 16 Pro Max

Friday October 4, 2024 12:04 pm PDT by
Now that it's been two weeks since the iPhone 16 models were released, we've been able to spend enough time with the new devices to share a more in-depth review on their performance, battery life, feature set, and more. Subscribe to the MacRumors YouTube channel for more videos. We've been testing the iPhone 16 Pro and Pro Max, but the gap between the Pro models and the standard iPhone 16...
Prime Big Deal Days Hero 3

The Best Early Prime Day Deals on AirPods, Apple Watch, and More

Friday October 4, 2024 10:43 am PDT by
Amazon is hosting another Prime Day event this year, called Amazon Prime Big Deal Days and offering shoppers the first chance to save on holiday shopping from a major retailer. Similar to the first Prime Day, it will last for two days (October 8-9) and you can already find a large selection of early deals across Amazon's storefront, covering savings on tech, clothing, video games, groceries, and...
macOS Sequoia Feature

Here Are All the New Features Coming to macOS Sequoia This Month

Thursday October 3, 2024 6:27 am PDT by
‌Apple in October will release macOS Sequoia‌ 15.1, bringing to Macs the first Apple Intelligence features such as Writing Tools, new Siri features, Smart Replies, and more. In addition, macOS 15.1 adds a handful of welcome tweaks and improvements to existing Mac capabilities. Here's what we can expect from the first major update to macOS Sequoia later this month. Note that Apple...
top stories 5oct2024

Top Stories: iOS 18.1 Coming Soon, October Apple Event Rumors, and More

Saturday October 5, 2024 6:00 am PDT by
It's hard to believe we're already into October with the iPhone 16 launch behind us, but there's lots more still to come from Apple this year on both the hardware and software fronts. We're still expecting a number of Mac and perhaps some iPad updates in the very near future, while Apple Intelligence features are set to begin rolling out with iOS 18.1 and related operating system updates....

Top Rated Comments

icanhazmac Avatar
14 months ago
No way I would ever allow another entity to "create" content in my voice. Before you know it you are getting canceled and apologizing for an AI error that caused "you" to say some horrific stuff in a language you don't even speak.
Score: 20 Votes (Like | Disagree)
NEPOBABY Avatar
14 months ago

I mean if it works reasonably well, why not? Wider audience and more revenue for the podcast.
There will definitely be many bad and messed up translations.

Relying on algorithms alone to translate languages is notoriously and famously difficult.

Anyone who has used YouTube or Instagram's translators knows how bad it is. Sometimes the meaning is changed completely.

Instagram translates my Chinese and Japanese friends posts wrong 50% of the time and converts their words into dumbed down American ghetto slang, which not only is a mistranslation but also paints people in a bad light.
Score: 14 Votes (Like | Disagree)
mrfunnypenguin Avatar
14 months ago
Have they completely forgot about HiFi?
Score: 6 Votes (Like | Disagree)
HobeSoundDarryl Avatar
14 months ago

I don’t see an issue with this. Everyone issue with AI (including mine) is lack of consent and getting payed for these AI companies stealing your work. If an artist agrees and is payed for their work getting used, I don’t see an issue.
Apple people see issues because this is a Spotify story. Take this one down, wait a day or two and put it back up as an Apple Podcasts story and we'll be gushing at Apple genius for the same thing. "We" are a very fair weather crowd. If it's an Apple innovation, it is genius. If it is an Apple competitor innovation, no one needs it, it's buggy as h*ll, it will never work right, security, privacy, risk of death/murder/mayhem/et all.

If it works pretty well, this seems great to me: great for Spotify, great for the podcasters, great for listeners who would like to hear some podcasts but in their own supported languages (even if there are some translation errors). Hopefully competition moves Apple to come up with the same or better ASAP. Competition is always good.
Score: 4 Votes (Like | Disagree)
zakarhino Avatar
14 months ago

any source about the android system implementation ?
None, I'm speculating this feature will be the next step up from the on device captions they already do. Apple added this last year or this year I think. Google have been doing it for years.

"All captions are processed locally, never stored, and never leave your device."

https://support.google.com/accessibility/android/answer/9350862?hl=en
Score: 3 Votes (Like | Disagree)
HobeSoundDarryl Avatar
14 months ago

I cannot stand watching movies where non native speakers do voiceovers. I much prefer subtitles.

Since Podcasts have overall not created growth for Spotify I presume that at some point they might drop them.
OK and OK. Apparently this has no benefit for you. Last I checked, there are other people in the world. Perhaps it's something THEY might appreciate while Spotify continues to offer them?
Score: 3 Votes (Like | Disagree)