Siri's Multiple Language Support Still Its Biggest Strength Over Other Virtual Assistants

Reuters published an article on Thursday that reveals some of the painstaking work that goes into making Siri capable of speaking additional languages, which remains one of its biggest strengths over rival virtual assistants.

The behind-the-scenes look appears amid claims that Apple has squandered its lead in the voice-assistant space, with Amazon, Google, and Microsoft all advancing the features of their respective assistants recently.

But for a smartphone market in which most sales are outside the U.S., Siri's big advantage over the other assistants is underlined in the number of languages it can speak. Microsoft is said to have an editorial team of 29 people who work to customize Cortana for local markets, while Google and Amazon say they plan to add more languages soon. But it's a game of catch-up: Apple already has 21 languages, localized for 36 countries. That compares favorably to Microsoft's Cortana (eight), Google Assistant (four), and Amazon's Alexa (two).

At Apple, the company starts working on a new language by bringing in humans to read passages in a range of accents and dialects, which are then transcribed by hand so the computer has an exact representation of the spoken text to learn from, said Alex Acero, head of the speech team at Apple. Apple also captures a range of sounds in a variety of voices. From there, a language model is built that tries to predict words sequences.

Then Apple deploys “dictation mode,” its text-to-speech translator, in the new language, Acero said. When customers use dictation mode, Apple captures a small percentage of the audio recordings and makes them anonymous. The recordings, complete with background noise and mumbled words, are transcribed by humans, a process that helps cut the speech recognition error rate in half.

Once the required amount of data has been gathered and a voice actor has recorded the Siri responses in a new language, Siri is released with answers to what Apple believes will be the most common questions. Siri then learns more about what users ask, with additional tweaks made via updates every two weeks.

The drawback to Apple's script-writing approach is that it does not scale, according to Charles Jolley, creator of an intelligent assistant named Oslo. "You can't hire enough writers to come up with the system you'd need in every language. You have to synthesize the answers," he told Reuters. "That's years off."

But it's something the founders of Viv – Siri's original creators – are actively working on. "Viv was built to specifically address the scaling issue for intelligent assistants," said Dag Kittlaus, the CEO and co-founder of Viv, which was acquired by Samsung last year. "The only way to leapfrog today's limited functionality versions is to open the system up and let the world teach them."

Consumers should soon get a taste of how far they've come. Viv technology will power Bixby, Samsung's new virtual assistant, set to feature in the Galaxy S8, which launches at the end of this month.

Top Rated Comments

(View all)
Avatar
40 months ago
Siri: misunderstanding you in 21 languages.
Score: 24 Votes (Like | Disagree)
Avatar
40 months ago
That's why when I totally naturally task Siri to "Weck mich um neun" (wake me up at nine) it will ask me in return "Welchen Weg möchtest du gehen?" (Which way do you want to go?)

Siri is pisspoor in German imho. You have to very presicely use keywords in order for Siri to recognize what you what. Speak naturally to it my ass.
Score: 21 Votes (Like | Disagree)
Avatar
40 months ago
more like it's only strength ;)
Score: 20 Votes (Like | Disagree)
Avatar
40 months ago
I want to be able to speak in multiple languages in the same sentence. This is necessary for asking Siri to send a text message -- maybe in a foreign language -- to friends with foreign names, or to ask for directions in a foreign country.
Score: 16 Votes (Like | Disagree)
Avatar
40 months ago
Improves every two weeks?
I only use four / five commands to Siri.
And apart from setting alarm, it usually makes silly mistakes in interpreting what I am asking for even though I have been repeating the same requests for the past 2 year!
Score: 16 Votes (Like | Disagree)
Avatar
40 months ago
So, what we're saying is Siri may be a multilingual idiot, but at least she's multilingual.
Score: 15 Votes (Like | Disagree)

Top Stories

Apple Acquires Weather App Dark Sky

Tuesday March 31, 2020 10:22 am PDT by Juli Clover
Apple has acquired weather app Dark Sky, Dark Sky's developers announced today. Dark Sky is one of the most popular weather apps on the App Store, known for its accuracy and storm warnings. Our goal has always been to provide the world with the best weather information possible, to help as many people as we can stay dry and safe, and to do so in a way that respects your privacy. There is no ...

Seemingly Unreleased Version of Logic Pro X With Live Loops Appears on Apple's Education Site [Updated]

Sunday March 29, 2020 7:23 am PDT by Hartley Charlton
Update: Apple has replaced the Logic Pro X image with an older version. Original story follows. A seemingly unreleased version of Logic Pro X has appeared on Apple's education site, as spotted by a Reddit user. The image from Apple's education products page shows a 16-inch MacBook Pro running Logic Pro X, but with a familiar interface that looks extremely similar to GarageBand's Live Loops ...

Bloomberg: Apple's 5G iPhone Still on Schedule for Fall Launch, But Future Products Could Be Delayed

Monday March 30, 2020 2:40 am PDT by Tim Hardwick
Apple's 5G iPhone is still on track to launch within the company's typical annual fall release schedule, according to a new Bloomberg report on filed on Monday. Signs are that Apple's Chinese-centric manufacturing -- of which Hon Hai is the linchpin -- is slowly getting back on track. The next iPhones with 5G wireless capabilities remain on schedule to launch in the fall, partly because mass...

Case for Upcoming Low-Cost iPhone Shows Up at Best Buy With Alleged April 5 Stock Date

Monday March 30, 2020 4:25 pm PDT by Juli Clover
Apple has a new low-cost iPhone in the works, which is supposed to be launching sometime in the first half of 2020. Given the ongoing situation in the United States and other countries, it's been unclear if the device is going to launch within the planned timeline, but there are signs that it could be coming soon. We started seeing cases for the new low-cost iPhone back in early February,...

Testing Brydge's New Pro+ Keyboard With Trackpad for iPad Pro

Monday March 30, 2020 2:04 pm PDT by Juli Clover
Well ahead of when Apple introduced trackpad support in iOS 13.4, Brydge announced an iPad Pro keyboard with a built-in multi-touch trackpad. We have one of Brydge's new Pro+ keyboards on hand, and thought we'd check it out to see how it works with Apple's new 2020 iPad Pro models. Subscribe to the MacRumors YouTube channel for more videos. The Brydge Pro+ keyboard is similar in design to...

Apple's Work on New Upcoming Products Progressing Normally as Employees Adjust to Telecommuting

Monday March 30, 2020 11:58 am PDT by Juli Clover
Apple's development of upcoming products is progressing as usual despite the fact that Apple employees around the world are working from home, according to a new report today out from Bloomberg. Apple is still working on new versions of the HomePod, Apple TV, MacBook Pro, budget iPads, Apple Watch, iPhone, and iMac, all of which could be released "as early as later this year" and have been...

Apple Releases ProRes RAW Beta for Windows

Monday March 30, 2020 9:33 am PDT by Juli Clover
Apple today released ProRes RAW for Windows in a beta capacity (via Mark Gurman), with the software designed to allow ProRes RAW and ProRes RAW HQ video files to be watched in compatible applications on Windows machines. According to Apple, the software will let the files be played within several Adobe apps: Adobe After Effects (Beta) Adobe Media Encocder (Beta) Adobe Premiere...

2020 iPad Pro Teardown Provides Closer Look at LiDAR Scanner and Confirms Incremental Update

Saturday March 28, 2020 9:56 am PDT by Hartley Charlton
iFixit today shared a video teardown of the new iPad Pro, which Apple unveiled earlier this month. iFixit found that most of the internals of the 2020 iPad Pro are the same as the 2018 model, confirming that the device is a relatively incremental update. The most notable new feature seen inside the new iPad Pro was the LiDAR scanner, which measures the distance to surrounding objects up...

Apple Configurator 2 Updated With New Features, Including Support for Restoring Firmware on 2019 Mac Pro

Tuesday March 31, 2020 5:34 am PDT by Joe Rossignol
Apple Configurator 2 has been updated to version 2.12 with several improvements, including support for restoring firmware on the 2019 Mac Pro. The release notes:• Added support for restoring firmware on the 2019 Mac Pro • Allow access to websites using TLS 1.0 and 1.1 • VPN: Configure Provider Designated Requirement for Custom SSL connection type • VPN: Configure network options for ...

U.S. Government Using Mobile Ad Location Data to Track Compliance With Curbs on Movement

Monday March 30, 2020 4:48 am PDT by Tim Hardwick
The U.S. government is using smartphone location data from the mobile ad industry to track people's movements amid the coronavirus outbreak, according to a Wall Street Journal report. Local governments and the Centers for Disease Control and Prevention have received the anonymized data about people in areas of "geographic interest," with the aim being to create a portal of geolocation...