Siri's Multiple Language Support Still Its Biggest Strength Over Other Virtual Assistants

Reuters published an article on Thursday that reveals some of the painstaking work that goes into making Siri capable of speaking additional languages, which remains one of its biggest strengths over rival virtual assistants.

The behind-the-scenes look appears amid claims that Apple has squandered its lead in the voice-assistant space, with Amazon, Google, and Microsoft all advancing the features of their respective assistants recently.

But for a smartphone market in which most sales are outside the U.S., Siri's big advantage over the other assistants is underlined in the number of languages it can speak. Microsoft is said to have an editorial team of 29 people who work to customize Cortana for local markets, while Google and Amazon say they plan to add more languages soon. But it's a game of catch-up: Apple already has 21 languages, localized for 36 countries. That compares favorably to Microsoft's Cortana (eight), Google Assistant (four), and Amazon's Alexa (two).

At Apple, the company starts working on a new language by bringing in humans to read passages in a range of accents and dialects, which are then transcribed by hand so the computer has an exact representation of the spoken text to learn from, said Alex Acero, head of the speech team at Apple. Apple also captures a range of sounds in a variety of voices. From there, a language model is built that tries to predict words sequences.

Then Apple deploys “dictation mode,” its text-to-speech translator, in the new language, Acero said. When customers use dictation mode, Apple captures a small percentage of the audio recordings and makes them anonymous. The recordings, complete with background noise and mumbled words, are transcribed by humans, a process that helps cut the speech recognition error rate in half.

Once the required amount of data has been gathered and a voice actor has recorded the Siri responses in a new language, Siri is released with answers to what Apple believes will be the most common questions. Siri then learns more about what users ask, with additional tweaks made via updates every two weeks.

The drawback to Apple's script-writing approach is that it does not scale, according to Charles Jolley, creator of an intelligent assistant named Oslo. "You can't hire enough writers to come up with the system you'd need in every language. You have to synthesize the answers," he told Reuters. "That's years off."

But it's something the founders of Viv – Siri's original creators – are actively working on. "Viv was built to specifically address the scaling issue for intelligent assistants," said Dag Kittlaus, the CEO and co-founder of Viv, which was acquired by Samsung last year. "The only way to leapfrog today's limited functionality versions is to open the system up and let the world teach them."

Consumers should soon get a taste of how far they've come. Viv technology will power Bixby, Samsung's new virtual assistant, set to feature in the Galaxy S8, which launches at the end of this month.

Top Rated Comments

(View all)
Avatar
44 months ago
Siri: misunderstanding you in 21 languages.
Score: 24 Votes (Like | Disagree)
Avatar
44 months ago
That's why when I totally naturally task Siri to "Weck mich um neun" (wake me up at nine) it will ask me in return "Welchen Weg möchtest du gehen?" (Which way do you want to go?)

Siri is pisspoor in German imho. You have to very presicely use keywords in order for Siri to recognize what you what. Speak naturally to it my ass.
Score: 21 Votes (Like | Disagree)
Avatar
44 months ago
more like it's only strength ;)
Score: 20 Votes (Like | Disagree)
Avatar
44 months ago
I want to be able to speak in multiple languages in the same sentence. This is necessary for asking Siri to send a text message -- maybe in a foreign language -- to friends with foreign names, or to ask for directions in a foreign country.
Score: 16 Votes (Like | Disagree)
Avatar
44 months ago
Improves every two weeks?
I only use four / five commands to Siri.
And apart from setting alarm, it usually makes silly mistakes in interpreting what I am asking for even though I have been repeating the same requests for the past 2 year!
Score: 16 Votes (Like | Disagree)
Avatar
44 months ago
So, what we're saying is Siri may be a multilingual idiot, but at least she's multilingual.
Score: 15 Votes (Like | Disagree)

Top Stories

iPhone 12 Sizes Compared with iPhone SE, 7, 8, SE 2, X, 11, 11 Pro and 11 Pro Max [Update]

Tuesday July 7, 2020 6:49 pm PDT by
Apple is planning on launching the iPhone 12 this fall which is rumored to be coming in 3 different sizes: 5.4", 6.1" and 6.7". The middle size (6.1") matches up with the currently shipping iPhone 11, but the other two sizes will be entirely new. Over the weekend, there was some excitement about how well the new 5.4" iPhone 12 compares to the original iPhone SE. Those who have been hoping...

Everything New in iOS 14 Beta 2: New Calendar Icon, Files Widget and More

Tuesday July 7, 2020 11:38 am PDT by
Apple today released the second beta of iOS 14 to developers for testing purposes, tweaking and refining some of the features that are coming in the update. Below, we've rounded up all of the changes that we found in the second beta. - Calendar icon - There's a new Calendar app icon in iOS 14 beta 2, with the day of the week abbreviated rather than spelled out. - Clock icon - The clock...

Hands On With iPhone 12 Models Showing New Sizes and Design

Monday July 6, 2020 2:04 pm PDT by
Ahead of the launch of new iPhones we often see dummy models created based on leaked schematics and specifications, with those models designed to let case makers create cases for the new devices ahead of their release. We got our hands on a set of dummy models that represent the iPhone 12 lineup, giving us our first close look at the iPhone 4-style design and the different size options. Subscri ...

Developer's Visual Comparison of macOS Catalina and Big Sur Offers Closer Look at Apple's UI Redesign for Macs

Tuesday July 7, 2020 4:00 am PDT by
macOS 11 Big Sur is the next major release of Apple's operating system for Mac, and following its preview at WWDC, one of the biggest discussions has revolved around the all-new user interface redesign. Developers are still learning what the impact the new UI will have on their apps, and with that in mind, app designer Andrew Denty has compiled an extensive visual comparison of the user...

Analyst Believes iPhone 12 Pricing Will Start $50 Higher Even Without EarPods or Charger in Box

Wednesday July 8, 2020 9:35 am PDT by
Despite multiple reports indicating that Apple will not include EarPods or a wall charger with iPhone 12 models this year, one analyst believes that pricing will still increase slightly compared to the iPhone 11 lineup. In a research note provided to MacRumors, analyst Jeff Pu forecasted that iPhone 12 pricing will start at $749 for a new 5.4-inch model, an increase of $50 over the base...

14-Inch MacBook Pro With Mini-LED Display Expected to Enter Production in 2021

Wednesday July 8, 2020 7:51 am PDT by
Apple suppliers will begin competing to win manufacturing orders for new 14-inch and 16-inch MacBook Pro models with Mini-LED displays in the first quarter of 2021, according to Taiwanese research firm TrendForce. Rumors of a 14-inch MacBook Pro have surfaced since Apple replaced the 15-inch MacBook Pro with a new 16-inch model last year. Apple analyst Ming-Chi Kuo has previously said that...

Apple Seeds First Betas of iOS 14 and iPadOS 14 to Public Beta Testers

Thursday July 9, 2020 10:14 am PDT by
Apple today seeded the first public betas of upcoming iOS and iPadOS 14 updates to its public beta testing group, two weeks after first providing the updates to developers after the WWDC keynote and a day after seeding the second developer betas. Public beta testers who have signed up for Apple's beta testing program can download the iOS/‌iPadOS‌ 14 updates over the air after installing ...

Apple's Arm-Based Macs With Apple Silicon Chips Will Support Thunderbolt

Wednesday July 8, 2020 3:14 pm PDT by
Apple is working on Macs that use its custom Apple-designed Apple Silicon chips instead of Intel chips, but Apple has committed to continuing to support Thunderbolt, reports The Verge. In a statement, an Apple spokesperson said that Apple's upcoming machines will offer support for Intel's Thunderbolt USB-C standard. "Over a decade ago, Apple partnered with Intel to design and develop...

Apple Cuts iPhone Trade-In Values as iPhone 12 Launch Nears

Tuesday July 7, 2020 7:46 am PDT by
With just two months to go until the usual timeframe for Apple's iPhone launch events, Apple is cutting back on maximum trade-in values of previous-generation iPhones for those looking to upgrade to a new model. Maximum values on more recent models have dropped by $30–$50, while older models have generally dropped by $5–$20 with a few models seeing no change in value.iPhone XS Max: $500 to...

Some iPhone Users Report Significant Battery Drain Due to Music App Background Activity in iOS 13.5.1

Wednesday July 8, 2020 1:49 am PDT by
A significant minority of iPhone users have taken to Apple's Support Communities and Reddit to report battery drain issues largely related to the Music app and high levels of background activity. Hundreds of users, many running iOS 13.5.1 on devices both new and old, are experiencing rapid battery drain when the Music app is not in use. In some cases, the background activity occurs over...