Night mode is an automatic setting which takes advantage of the new wide-angle camera that's in the iPhone 11 and 11 Pro models. It's equipped with a larger sensor that is able to let in more light, allowing for brighter photos when the light is low.
macOS Catalina Now Available
Apple Says 'Hey Siri' Detection Briefly Becomes Extra Sensitive If Your First Try Doesn't Work
A new entry in Apple's Machine Learning Journal provides a closer look at how hardware, software, and internet services work together to power the hands-free "Hey Siri" feature on the latest iPhone and iPad Pro models.
Specifically, a very small speech recognizer built into the embedded motion coprocessor runs all the time and listens for "Hey Siri." When just those two words are detected, Siri parses any subsequent speech as a command or query.
The detector uses a Deep Neural Network to convert the acoustic pattern of a user's voice into a probability distribution. It then uses a temporal integration process to compute a confidence score that the phrase uttered was "Hey Siri."
If the score is high enough, Siri wakes up and proceeds to complete the command or answer the query automatically.
If the score exceeds Apple's lower threshold but not the upper threshold, however, the device enters a more sensitive state for a few seconds, so that Siri is much more likely to be invoked if the user repeats the phrase—even without more effort.
"This second-chance mechanism improves the usability of the system significantly, without increasing the false alarm rate too much because it is only in this extra-sensitive state for a short time," said Apple.
To reduce false triggers from strangers, Apple invites users to complete a short enrollment session in which they say five phrases that each begin with "Hey Siri." The examples are saved on the device.
For many more technical details about how "Hey Siri" works, be sure to read Apple's full article on its Machine Learning Journal.
Specifically, a very small speech recognizer built into the embedded motion coprocessor runs all the time and listens for "Hey Siri." When just those two words are detected, Siri parses any subsequent speech as a command or query.
The detector uses a Deep Neural Network to convert the acoustic pattern of a user's voice into a probability distribution. It then uses a temporal integration process to compute a confidence score that the phrase uttered was "Hey Siri."
If the score is high enough, Siri wakes up and proceeds to complete the command or answer the query automatically.
If the score exceeds Apple's lower threshold but not the upper threshold, however, the device enters a more sensitive state for a few seconds, so that Siri is much more likely to be invoked if the user repeats the phrase—even without more effort.
"This second-chance mechanism improves the usability of the system significantly, without increasing the false alarm rate too much because it is only in this extra-sensitive state for a short time," said Apple.
To reduce false triggers from strangers, Apple invites users to complete a short enrollment session in which they say five phrases that each begin with "Hey Siri." The examples are saved on the device.
We compare the distances to the reference patterns created during enrollment with another threshold to decide whether the sound that triggered the detector is likely to be "Hey Siri" spoken by the enrolled user.Apple also says it created "Hey Siri" recordings both close and far in various environments, such as in the kitchen, car, bedroom, and restaurant, based on native speakers of many languages around the world.
This process not only reduces the probability that "Hey Siri" spoken by another person will trigger the iPhone, but also reduces the rate at which other, similar-sounding phrases trigger Siri.
For many more technical details about how "Hey Siri" works, be sure to read Apple's full article on its Machine Learning Journal.
Tags: Siri Guide, machine learning
[ 92 comments ]
Top Rated Comments
(View all)
26 months ago
There's a lot going on behind the scenes with Siri. I don't think we give her enough credit.
My biggest problem with Siri is not any of the silly one-off bugs that get memed to death on the internet.My biggest problem was described beautifully in a recent article I read somewhere. About how a voice assistant with 10 possible working commands is great. And one with unlimited working commands is great. But one with hundreds of working commands is terrible, because the user will never know what all those commands are. They will just use the core few that they know. And if they try a command and it isn't one of those hundreds, it causes confusion and doubt.
26 months ago
Soon enough Siri is going to be smarter than Apple executives realizing that the MacMini needs an update ASAP.
26 months ago
There's a lot going on behind the scenes with Siri. I don't think we give her enough credit.
26 months ago
Everything about Siri is amazing, and far beyond any competition.
Except her ability to do stuff.
Except her ability to do stuff.
26 months ago
I just had a quick check on the Mac to see if anything's changed...
Me: "How many files have I opened today?"
Siri: "on the internet I found 'how big is Allah.'"
maybe next year
Me: "How many files have I opened today?"
Siri: "on the internet I found 'how big is Allah.'"
maybe next year
26 months ago
There has to be something new going on with regards to it’s understanding. After initiating Hey Siri in the car, her comprehension through the Bluetooth system has been notably better for me during the past year. I was wondering if the 7 was doing some machine learning locally, or if the cloud was parsing my questions better with this device. My 5S still struggles with my voice, though it could also be the mics on that device too.
Apple would help Siri’s reputation a lot, by keeping an active Wiki going for the service, and what commands it will respond to. Because many people have tried to use Siri once for a specific task, found it didn’t work, and since given up. It is really hard for a general user to discover new tricks.
Places like iMore do a decent job of documenting, but, it would be AWESOME if the source had a good manual for it..
My biggest problem with Siri is not any of the silly one-off bugs that get memed to death on the internet.
My biggest problem was described beautifully in a recent article I read somewhere. About how a voice assistant with 10 possible working commands is great. And one with unlimited working commands is great. But one with hundreds of working commands is terrible, because the user will never know what all those commands are. They will just use the core few that they know. And if they try a command and it isn't one of those hundreds, it causes confusion and doubt.
Apple would help Siri’s reputation a lot, by keeping an active Wiki going for the service, and what commands it will respond to. Because many people have tried to use Siri once for a specific task, found it didn’t work, and since given up. It is really hard for a general user to discover new tricks.
Places like iMore do a decent job of documenting, but, it would be AWESOME if the source had a good manual for it..
26 months ago
“It then uses a temporal integration process to compute a confidence score”
But won’t the tachyons interfere with the marzipan regulators when they do this?
But won’t the tachyons interfere with the marzipan regulators when they do this?
26 months ago
If only Apple's ears got into a more "sensitive state" when they hear the phrase "we want a headphone jack".
26 months ago
"Always listening" ha.... first thing in the morning? Nope, won't work until I open my phone. It seems to stop 'listening' for me after about 2 hours of inactivity on my phone. And yes I have the always listening turned on.
[ Read All Comments ]
Apple today sent out emails for a new Apple Pay promotion, offering a $5 discount on groceries when you spend $35 or more through Instacart. To get the discount, you'll need to use Apple...
Luna Display today introduced a new Mac-to-Mac mode that allows any Mac released within the last decade to be used as a second display for another Mac. This includes any combination of Macs, ranging...
Apple has released a third trailer for the upcoming comedy series "Dickinson" ahead of its November 1 premiere on Apple TV+.
Dickinson is a half-hour comedy series starring...
Adobe remains committed to releasing Photoshop CC for the iPad by the end of 2019, and plans to provide an update on the app at its Adobe MAX creative conference in early November, according to...
Smart camera brand Arlo has launched a new internet connected Video Doorbell that's "designed to capture what traditional video doorbells can't."
Arlo says the Video Doorbell...
While not yet reflected on Apple's system status page, a number of Apple services are currently experiencing downtime or slow performance, including the App Store, Apple Music, iCloud, and the...
Apple today seeded the fourth beta of an upcoming watchOS 6.1 beta to developers, just under a week after seeding the third watchOS 6.1 beta and a month after releasing the watchOS 6 update with full...
Apple today seeded the third beta of an upcoming tvOS 13.2 update to developers for testing purposes, just under a week after seeding the second tvOS 13.2 beta and three weeks after releasing the...
