Siri's Multiple Language Support Still Its Biggest Strength Over Other Virtual Assistants

iOS 9 SiriReuters published an article on Thursday that reveals some of the painstaking work that goes into making Siri capable of speaking additional languages, which remains one of its biggest strengths over rival virtual assistants.

The behind-the-scenes look appears amid claims that Apple has squandered its lead in the voice-assistant space, with Amazon, Google, and Microsoft all advancing the features of their respective assistants recently.

But for a smartphone market in which most sales are outside the U.S., Siri's big advantage over the other assistants is underlined in the number of languages it can speak. Microsoft is said to have an editorial team of 29 people who work to customize Cortana for local markets, while Google and Amazon say they plan to add more languages soon. But it's a game of catch-up: Apple already has 21 languages, localized for 36 countries. That compares favorably to Microsoft's Cortana (eight), Google Assistant (four), and Amazon's Alexa (two).

At Apple, the company starts working on a new language by bringing in humans to read passages in a range of accents and dialects, which are then transcribed by hand so the computer has an exact representation of the spoken text to learn from, said Alex Acero, head of the speech team at Apple. Apple also captures a range of sounds in a variety of voices. From there, a language model is built that tries to predict words sequences.

Then Apple deploys “dictation mode,” its text-to-speech translator, in the new language, Acero said. When customers use dictation mode, Apple captures a small percentage of the audio recordings and makes them anonymous. The recordings, complete with background noise and mumbled words, are transcribed by humans, a process that helps cut the speech recognition error rate in half.

Once the required amount of data has been gathered and a voice actor has recorded the Siri responses in a new language, Siri is released with answers to what Apple believes will be the most common questions. Siri then learns more about what users ask, with additional tweaks made via updates every two weeks.

The drawback to Apple's script-writing approach is that it does not scale, according to Charles Jolley, creator of an intelligent assistant named Oslo. "You can't hire enough writers to come up with the system you'd need in every language. You have to synthesize the answers," he told Reuters. "That's years off."

But it's something the founders of Viv – Siri's original creators – are actively working on. "Viv was built to specifically address the scaling issue for intelligent assistants," said Dag Kittlaus, the CEO and co-founder of Viv, which was acquired by Samsung last year. "The only way to leapfrog today's limited functionality versions is to open the system up and let the world teach them."

Consumers should soon get a taste of how far they've come. Viv technology will power Bixby, Samsung's new virtual assistant, set to feature in the Galaxy S8, which launches at the end of this month.

Top Rated Comments

Scottsoapbox Avatar
75 months ago
Siri: misunderstanding you in 21 languages.
Score: 24 Votes (Like | Disagree)
Galatian Avatar
75 months ago
That's why when I totally naturally task Siri to "Weck mich um neun" (wake me up at nine) it will ask me in return "Welchen Weg möchtest du gehen?" (Which way do you want to go?)

Siri is pisspoor in German imho. You have to very presicely use keywords in order for Siri to recognize what you what. Speak naturally to it my ass.
Score: 21 Votes (Like | Disagree)
Nozuka Avatar
75 months ago
more like it's only strength ;)
Score: 20 Votes (Like | Disagree)
allenvanhellen Avatar
75 months ago
I want to be able to speak in multiple languages in the same sentence. This is necessary for asking Siri to send a text message -- maybe in a foreign language -- to friends with foreign names, or to ask for directions in a foreign country.
Score: 16 Votes (Like | Disagree)
thasan Avatar
75 months ago
Improves every two weeks?
I only use four / five commands to Siri.
And apart from setting alarm, it usually makes silly mistakes in interpreting what I am asking for even though I have been repeating the same requests for the past 2 year!
Score: 16 Votes (Like | Disagree)
longofest Avatar
75 months ago
So, what we're saying is Siri may be a multilingual idiot, but at least she's multilingual.
Score: 15 Votes (Like | Disagree)

Popular Stories

Apple advanced security Advanced Data Protection screen Feature

FBI Calls End-to-End Encryption 'Deeply Concerning' as Privacy Groups Hail Apple's Advanced Data Protection as a Victory for Users

Thursday December 8, 2022 2:45 am PST by
Apple yesterday announced that end-to-end encryption is coming to even more sensitive types of iCloud data, including device backups, messages, photos, and more, meeting the longstanding demand of both users and privacy groups who have rallied for the company to take the significant step forward in user privacy. iCloud end-to-end encryption, or what Apple calls "Advanced Data Protection,"...
General iOS 16 Feature Yellow

iOS 16.2 for iPhone Expected to Launch Next Week With These 12 New Features

Thursday December 8, 2022 7:05 am PST by
iOS 16.2 is expected to be released next week following nearly two months of beta testing. With last-minute additions like Apple Music Sing and Advanced Data Protection, the software update now has over a dozen new features for the iPhone. Below, we've recapped many of the new features coming with iOS 16.2, including Apple's new whiteboard app Freeform, two new Lock Screen widgets, the...
maxresdefault

Can't Get an iPhone 14 Pro? Here's Why You Should Wait for the iPhone 15 Ultra

Monday December 5, 2022 11:44 am PST by
Due to production issues at Apple supplier factories in China, the iPhone 14 Pro and iPhone 14 Pro Max are backordered and basically out of stock at every store. If you were planning to gift or receive an iPhone 14 Pro model for the holidays and didn't already get one, you're basically out of luck because they're gone until late December. Subscribe to the MacRumors YouTube channel for more ...
maxresdefault

Hands-On With Apple Music Sing in iOS 16.2

Wednesday December 7, 2022 12:24 pm PST by
With the iOS 16.2 release candidate that came out today, Apple added the new Apple Music Sing feature that was announced earlier this week. We thought we'd check out the new karaoke feature to see how it works. Subscribe to the MacRumors YouTube channel for more videos. Apple Music Sing is available on modern iPhones and iPads, as well as the newest Apple TV 4K. It's built in to the Apple...
General iOS 16 Feature Yellow

iOS 16.2 for iPhone Launching This Month With These 8 New Features

Thursday December 1, 2022 8:44 am PST by
Apple plans to publicly release iOS 16.2 for the iPhone in mid-December, according to Bloomberg's Mark Gurman. The update remains in beta testing for now, with at least eight new features and changes already uncovered so far. iOS 16.2 introduces a number of new features, including Apple's new whiteboard app Freeform, two new Lock Screen widgets for Sleep and Medications, the ability to hide...
Apple Accessories Deals 2022 Anker

Deals: Amazon's New Anker Sale Has Savings on USB-C Chargers, Portable Batteries, and More

Wednesday December 7, 2022 8:10 am PST by
Anker this week has introduced a new sale across its most popular accessories on Amazon, including savings on USB-C cables, wall chargers, portable batteries, wireless chargers, and more. Note: MacRumors is an affiliate partner with some of these vendors. When you click a link and make a purchase, we may receive a small payment, which helps us keep the site running. Many of these sales...
Apple advanced security Advanced Data Protection screen Feature

Apple Announces End-to-End Encryption Option for iCloud Photos, Notes, Backups, and More

Wednesday December 7, 2022 10:00 am PST by
Apple today announced it is expanding end-to-end encryption to many additional iCloud data categories on an opt-in basis for enhanced security. iCloud already protects 14 data categories using end-to-end encryption by default, including the Messages app when backups are disabled, passwords stored in iCloud Keychain, Health data, Apple Maps search history, Apple Card transactions, and more,...
Twitter Feature

Twitter to Charge $11 Per Month for Twitter Blue on iPhone, $7 on Website

Wednesday December 7, 2022 6:47 pm PST by
Twitter plans to charge $11 per month for a Twitter Blue subscription on the iPhone in order to account for the 30 percent cut that Apple takes from in-app purchases, reports The Information. On the web, Twitter Blue will be priced at $7 per month. Prior to when Twitter Blue was paused, Twitter was charging $7.99 for a subscription, but the pricing will change before it relaunches. According ...
Apple car wheel icon feature yellow

Apple to Charge Under $100,000 for Apple Car, Launch Planned for 2026

Tuesday December 6, 2022 2:31 pm PST by
Apple is aiming to launch an Apple-branded consumer-oriented vehicle by 2026, and its goal is to hit a price point under $100,000 to make the car appeal to a wider range of customers, reports Bloomberg. Apple initially planned to design a car that might look similar to Canoo's Lifestyle Vehicle, where passengers could face one another in a limousine-style car with no steering wheel or...