Apple Will Continue to Review Computer-Generated Siri Transcripts Regardless of Opt-In Status

Apple has published a new support document with several questions and answers about its Siri quality evaluation process, also known as grading, to address any privacy concerns that customers may have.


As a refresher, it was recently discovered that Apple hired contractors to listen to a small percentage of anonymized Siri recordings — and review their corresponding computer-generated transcripts — to measure how well Siri was responding and to improve the assistant's accuracy and reliability.

The human review process likely existed for quite some time, but it was never mentioned in Apple's privacy policy, and it only became the subject of controversy last month after The Guardian reported that contractors "regularly" heard "confidential details" while listening to the Siri audio recordings.

Following that report, Apple quickly suspended its grading program and conducted a review of its policies. Apple has since apologized over the matter and says it will resume the evaluation process in the fall on an opt-in basis with improved privacy measures, including no longer retaining audio recordings.

In its FAQ, however, Apple says it will continue to review anonymized computer-generated transcripts of Siri interactions, even from users who do not opt in. The only way to avoid this will be to disable Siri entirely:

Is the only way for Siri not to retain my audio recordings and transcripts to disable Siri?

By default, Apple will no longer retain audio of your Siri requests, starting with a future software release in fall 2019. Computer-generated transcriptions of your audio requests may be used to improve Siri. These transcriptions are associated with a random identifier, not your Apple ID, for up to six months. If you do not want transcriptions of your Siri audio recordings to be retained, you can disable Siri and Dictation in Settings.

Prior to suspending grading, Apple says it reviewed less than 0.2 percent of Siri interactions and corresponding computer-generated transcripts.

As for users that do opt in, Apple says it has updated its review process to limit graders' exposure to audio recordings that are determined to have resulted from Siri being triggered inadvertently. Apple is also making changes to minimize the amount of data that the graders have access to:

When you say you are minimizing the amount of data reviewers have access to, what does that mean? What will they still be able to hear?

We are making changes to the human grading process to further minimize the amount of data reviewers have access to, so that they see only the data necessary to effectively do their work. For example, the names of the devices and rooms you setup in the Home app will only be accessible by the reviewer if the request being graded involves controlling devices in the home.

Apple says it will work to delete any recording which is determined to have resulted from Siri being triggered inadvertently.

The changes to Siri will be implemented in a future iOS update released this fall, which will likely introduce a toggle switch for grading. For more details, read Apple's support document and its related press release.

Top Rated Comments

(View all)
Avatar
8 months ago
I don't recall the last time I used Siri for anything
Score: 17 Votes (Like | Disagree)
Avatar
8 months ago
You should be able to opt out of this.
Score: 13 Votes (Like | Disagree)
Avatar
8 months ago

I don't recall the last time I used Siri for anything

I’m sure you will get criticism on this site for your comment, but I totally agree with you. Like Apple Maps, I repeatedly tried using Siri early in its lifespan, and both were inferior to other options. I just don’t use either anymore. Every now and then I try to make a reminder using Siri on my Apple Watch, half the time waiting for it to “tap me when it’s ready.” Swing and a miss.
Score: 11 Votes (Like | Disagree)
Avatar
8 months ago
And people actually spend 1k on phones only to pretend they will have any privacy. What a time to be alive.
Score: 9 Votes (Like | Disagree)
Avatar
8 months ago

The article says the testing will be opt-in. Even better.

I think you're mixed up, the ability for employees to listen to audio samples will be opt-in. Employees will still be able to read all computer-generated transcripts, and there's no way to opt-out of this.
[doublepost=1567013513][/doublepost]

Did I miss something in the article? What does the opt-in do if they still listen on my recordings?

It's opt-in for only for audio recordings, they can review text transcripts with people that don't opt in.
Score: 7 Votes (Like | Disagree)
Avatar
8 months ago
Pro tip: Assume everything you are doing will eventually be found out. Be upfront with information like this from the beginning. Most people don't care about these things as long as you are clear about what you are doing with data, why it is necessary, and how you can opt out if desired.
Score: 7 Votes (Like | Disagree)

Top Stories

Apple Acquires Weather App Dark Sky

Tuesday March 31, 2020 10:22 am PDT by Juli Clover
Apple has acquired weather app Dark Sky, Dark Sky's developers announced today. Dark Sky is one of the most popular weather apps on the App Store, known for its accuracy and storm warnings. Our goal has always been to provide the world with the best weather information possible, to help as many people as we can stay dry and safe, and to do so in a way that respects your privacy. There is no ...

Seemingly Unreleased Version of Logic Pro X With Live Loops Appears on Apple's Education Site [Updated]

Sunday March 29, 2020 7:23 am PDT by Hartley Charlton
Update: Apple has replaced the Logic Pro X image with an older version. Original story follows. A seemingly unreleased version of Logic Pro X has appeared on Apple's education site, as spotted by a Reddit user. The image from Apple's education products page shows a 16-inch MacBook Pro running Logic Pro X, but with a familiar interface that looks extremely similar to GarageBand's Live Loops ...

Bloomberg: Apple's 5G iPhone Still on Schedule for Fall Launch, But Future Products Could Be Delayed

Monday March 30, 2020 2:40 am PDT by Tim Hardwick
Apple's 5G iPhone is still on track to launch within the company's typical annual fall release schedule, according to a new Bloomberg report on filed on Monday. Signs are that Apple's Chinese-centric manufacturing -- of which Hon Hai is the linchpin -- is slowly getting back on track. The next iPhones with 5G wireless capabilities remain on schedule to launch in the fall, partly because mass...

Case for Upcoming Low-Cost iPhone Shows Up at Best Buy With Alleged April 5 Stock Date

Monday March 30, 2020 4:25 pm PDT by Juli Clover
Apple has a new low-cost iPhone in the works, which is supposed to be launching sometime in the first half of 2020. Given the ongoing situation in the United States and other countries, it's been unclear if the device is going to launch within the planned timeline, but there are signs that it could be coming soon. We started seeing cases for the new low-cost iPhone back in early February,...

Testing Brydge's New Pro+ Keyboard With Trackpad for iPad Pro

Monday March 30, 2020 2:04 pm PDT by Juli Clover
Well ahead of when Apple introduced trackpad support in iOS 13.4, Brydge announced an iPad Pro keyboard with a built-in multi-touch trackpad. We have one of Brydge's new Pro+ keyboards on hand, and thought we'd check it out to see how it works with Apple's new 2020 iPad Pro models. Subscribe to the MacRumors YouTube channel for more videos. The Brydge Pro+ keyboard is similar in design to...

Apple's Work on New Upcoming Products Progressing Normally as Employees Adjust to Telecommuting

Monday March 30, 2020 11:58 am PDT by Juli Clover
Apple's development of upcoming products is progressing as usual despite the fact that Apple employees around the world are working from home, according to a new report today out from Bloomberg. Apple is still working on new versions of the HomePod, Apple TV, MacBook Pro, budget iPads, Apple Watch, iPhone, and iMac, all of which could be released "as early as later this year" and have been...

Apple Releases ProRes RAW Beta for Windows

Monday March 30, 2020 9:33 am PDT by Juli Clover
Apple today released ProRes RAW for Windows in a beta capacity (via Mark Gurman), with the software designed to allow ProRes RAW and ProRes RAW HQ video files to be watched in compatible applications on Windows machines. According to Apple, the software will let the files be played within several Adobe apps: Adobe After Effects (Beta) Adobe Media Encocder (Beta) Adobe Premiere...

2020 iPad Pro Teardown Provides Closer Look at LiDAR Scanner and Confirms Incremental Update

Saturday March 28, 2020 9:56 am PDT by Hartley Charlton
iFixit today shared a video teardown of the new iPad Pro, which Apple unveiled earlier this month. iFixit found that most of the internals of the 2020 iPad Pro are the same as the 2018 model, confirming that the device is a relatively incremental update. The most notable new feature seen inside the new iPad Pro was the LiDAR scanner, which measures the distance to surrounding objects up...

Apple Configurator 2 Updated With New Features, Including Support for Restoring Firmware on 2019 Mac Pro

Tuesday March 31, 2020 5:34 am PDT by Joe Rossignol
Apple Configurator 2 has been updated to version 2.12 with several improvements, including support for restoring firmware on the 2019 Mac Pro. The release notes:• Added support for restoring firmware on the 2019 Mac Pro • Allow access to websites using TLS 1.0 and 1.1 • VPN: Configure Provider Designated Requirement for Custom SSL connection type • VPN: Configure network options for ...

U.S. Government Using Mobile Ad Location Data to Track Compliance With Curbs on Movement

Monday March 30, 2020 4:48 am PDT by Tim Hardwick
The U.S. government is using smartphone location data from the mobile ad industry to track people's movements amid the coronavirus outbreak, according to a Wall Street Journal report. Local governments and the Centers for Disease Control and Prevention have received the anonymized data about people in areas of "geographic interest," with the aim being to create a portal of geolocation...