Siri's Multiple Language Support Still Its Biggest Strength Over Other Virtual Assistants

iOS 9 SiriReuters published an article on Thursday that reveals some of the painstaking work that goes into making Siri capable of speaking additional languages, which remains one of its biggest strengths over rival virtual assistants.

The behind-the-scenes look appears amid claims that Apple has squandered its lead in the voice-assistant space, with Amazon, Google, and Microsoft all advancing the features of their respective assistants recently.

But for a smartphone market in which most sales are outside the U.S., Siri's big advantage over the other assistants is underlined in the number of languages it can speak. Microsoft is said to have an editorial team of 29 people who work to customize Cortana for local markets, while Google and Amazon say they plan to add more languages soon. But it's a game of catch-up: Apple already has 21 languages, localized for 36 countries. That compares favorably to Microsoft's Cortana (eight), Google Assistant (four), and Amazon's Alexa (two).

At Apple, the company starts working on a new language by bringing in humans to read passages in a range of accents and dialects, which are then transcribed by hand so the computer has an exact representation of the spoken text to learn from, said Alex Acero, head of the speech team at Apple. Apple also captures a range of sounds in a variety of voices. From there, a language model is built that tries to predict words sequences.

Then Apple deploys “dictation mode,” its text-to-speech translator, in the new language, Acero said. When customers use dictation mode, Apple captures a small percentage of the audio recordings and makes them anonymous. The recordings, complete with background noise and mumbled words, are transcribed by humans, a process that helps cut the speech recognition error rate in half.

Once the required amount of data has been gathered and a voice actor has recorded the Siri responses in a new language, Siri is released with answers to what Apple believes will be the most common questions. Siri then learns more about what users ask, with additional tweaks made via updates every two weeks.

The drawback to Apple's script-writing approach is that it does not scale, according to Charles Jolley, creator of an intelligent assistant named Oslo. "You can't hire enough writers to come up with the system you'd need in every language. You have to synthesize the answers," he told Reuters. "That's years off."

But it's something the founders of Viv – Siri's original creators – are actively working on. "Viv was built to specifically address the scaling issue for intelligent assistants," said Dag Kittlaus, the CEO and co-founder of Viv, which was acquired by Samsung last year. "The only way to leapfrog today's limited functionality versions is to open the system up and let the world teach them."

Consumers should soon get a taste of how far they've come. Viv technology will power Bixby, Samsung's new virtual assistant, set to feature in the Galaxy S8, which launches at the end of this month.

Top Rated Comments

Scottsoapbox Avatar
64 months ago
Siri: misunderstanding you in 21 languages.
Score: 24 Votes (Like | Disagree)
Galatian Avatar
64 months ago
That's why when I totally naturally task Siri to "Weck mich um neun" (wake me up at nine) it will ask me in return "Welchen Weg möchtest du gehen?" (Which way do you want to go?)

Siri is pisspoor in German imho. You have to very presicely use keywords in order for Siri to recognize what you what. Speak naturally to it my ass.
Score: 21 Votes (Like | Disagree)
Nozuka Avatar
64 months ago
more like it's only strength ;)
Score: 20 Votes (Like | Disagree)
allenvanhellen Avatar
64 months ago
I want to be able to speak in multiple languages in the same sentence. This is necessary for asking Siri to send a text message -- maybe in a foreign language -- to friends with foreign names, or to ask for directions in a foreign country.
Score: 16 Votes (Like | Disagree)
thasan Avatar
64 months ago
Improves every two weeks?
I only use four / five commands to Siri.
And apart from setting alarm, it usually makes silly mistakes in interpreting what I am asking for even though I have been repeating the same requests for the past 2 year!
Score: 16 Votes (Like | Disagree)
longofest Avatar
64 months ago
So, what we're saying is Siri may be a multilingual idiot, but at least she's multilingual.
Score: 15 Votes (Like | Disagree)

Popular Stories

airpodsinear 1

AirPods Save Woman's Life With Feature Everyone Should Know

Friday January 21, 2022 2:13 am PST by
Apple's AirPods have been credited with saving a woman's life after a potentially fatal fall, People reports. When a 60-year-old florist in New Jersey tripped and hit her head in her studio, she lost consciousness and awoke heavily bleeding. With nobody around to call for help, she realized she had her AirPods in, and used a "Hey Siri" command to call 911. An operator was able to stay on the ...
maxresdefault

Review: M1 Max MacBook Pro After Three Months

Wednesday January 19, 2022 11:30 am PST by
It's now been a few months since the M1 Pro and M1 Max MacBook Pro models launched in October, and MacRumors video editor Dan Barbera has been using one of the new machines since they debuted. Over on the MacRumors YouTube channel, Dan has shared a three month review of his MacBook Pro to see how it has held up over time and how it's changed his workflow. Subscribe to the MacRumors YouTube ...
iphone se 2020 top

New iPhone SE Likely to Launch in April Based on Production Timeframe

Wednesday January 19, 2022 6:44 am PST by
Apple suppliers will begin producing display panels for the third-generation iPhone SE this month, with final assembly of the device likely to start in March, according to information shared by display industry consultant Ross Young. Based on this production timeframe, Young believes the third-generation iPhone SE is likely to launch in the second half of April, or perhaps in early May at...
iphone 13 earpods

Apple to Stop Including EarPods With Every iPhone Sold in France From Next Week

Friday January 21, 2022 3:21 am PST by
Apple will no longer include EarPods with every iPhone sold in France, starting on January 24, according to a notice posted by a French carrier (via iGeneration). Apple was previously required to include EarPods in the box with the iPhone due to a French law that required every smartphone sold in the country to come with a "handsfree kit," but the law has now been changed in favor of reducing the ...
Spring 2022 Apple Products Feature

New iPad Air, Macs, and iPhone SE With 5G Likely to Be Announced at Apple Event This Spring

Thursday January 20, 2022 8:32 am PST by
Earlier this week, Bloomberg's Mark Gurman tweeted that Apple "will be holding a spring event" to announce a new iPhone SE and other hardware. In a recent edition of his newsletter, Gurman said the event is likely to occur in March or April. Gurman did not elaborate on what "other hardware" will be announced at Apple's purported spring event, but rumors suggest at least four products are...
peloton tv workout cardio

Apple Floated as Potential Buyer of Peloton

Friday January 21, 2022 6:11 am PST by
Following months of bleak news about Peloton's "precarious state," including the revelation that it has halted production of its bikes and treadmills, Apple is being floated as a potential buyer of Peloton's troubled fitness business. Yesterday, CNBC reported that Peloton will temporarily stop production of its connected fitness products due to a "significant reduction" in consumer demand, a ...
apple watch series 7 aluminum colors yellowbg

Apple Watch Charging Bug Fixed in watchOS 8.4 Release Candidate

Thursday January 20, 2022 4:01 pm PST by
The watchOS 8.4 release candidate that was seeded to developers and beta testers this morning addresses an ongoing bug that could cause some Apple Watch chargers not to work properly with the Apple Watch. Back in December, we reported on a growing number of charging issues that Apple Watch Series 7 owners were facing. Since watchOS 8.3, there have been a number of complaints about...
appleprivacyad cleaned

iOS 15 Patched Security Hole That Potentially Exposed Users' Private Apple ID Information to Third-Party Apps

Thursday January 20, 2022 3:32 am PST by
Apple patched two significant security vulnerabilities when it released iOS 15 that could have potentially exposed users' private Apple ID information and in-app search history to malicious third-party apps and allowed apps to override user Privacy preferences, Apple has revealed in a recent support document update. With most iOS, macOS, tvOS, and watchOS updates, Apple provides a list of...
safari icon blue banner

macOS Monterey 12.2 and iOS 15.3 Release Candidates Fix Safari Bug That Leaks Browsing Activity

Thursday January 20, 2022 1:30 pm PST by
The macOS Monterey 12.2 and iOS 15.3 release candidates that came out today appear to address a Safari bug that could cause your recent browsing history and details about your identity to be leaked to malicious entities. As shared last week by browser fingerprinting service FingerprintJS, there is an issue with the WebKit implementation of the IndexedDB JavaScript API. Any website that uses...