Apple Will Continue to Review Computer-Generated Siri Transcripts Regardless of Opt-In Status

Apple has published a new support document with several questions and answers about its Siri quality evaluation process, also known as grading, to address any privacy concerns that customers may have.


As a refresher, it was recently discovered that Apple hired contractors to listen to a small percentage of anonymized Siri recordings — and review their corresponding computer-generated transcripts — to measure how well Siri was responding and to improve the assistant's accuracy and reliability.

The human review process likely existed for quite some time, but it was never mentioned in Apple's privacy policy, and it only became the subject of controversy last month after The Guardian reported that contractors "regularly" heard "confidential details" while listening to the Siri audio recordings.

Following that report, Apple quickly suspended its grading program and conducted a review of its policies. Apple has since apologized over the matter and says it will resume the evaluation process in the fall on an opt-in basis with improved privacy measures, including no longer retaining audio recordings.

In its FAQ, however, Apple says it will continue to review anonymized computer-generated transcripts of Siri interactions, even from users who do not opt in. The only way to avoid this will be to disable Siri entirely:

Is the only way for Siri not to retain my audio recordings and transcripts to disable Siri?

By default, Apple will no longer retain audio of your Siri requests, starting with a future software release in fall 2019. Computer-generated transcriptions of your audio requests may be used to improve Siri. These transcriptions are associated with a random identifier, not your Apple ID, for up to six months. If you do not want transcriptions of your Siri audio recordings to be retained, you can disable Siri and Dictation in Settings.

Prior to suspending grading, Apple says it reviewed less than 0.2 percent of Siri interactions and corresponding computer-generated transcripts.

As for users that do opt in, Apple says it has updated its review process to limit graders' exposure to audio recordings that are determined to have resulted from Siri being triggered inadvertently. Apple is also making changes to minimize the amount of data that the graders have access to:

When you say you are minimizing the amount of data reviewers have access to, what does that mean? What will they still be able to hear?

We are making changes to the human grading process to further minimize the amount of data reviewers have access to, so that they see only the data necessary to effectively do their work. For example, the names of the devices and rooms you setup in the Home app will only be accessible by the reviewer if the request being graded involves controlling devices in the home.

Apple says it will work to delete any recording which is determined to have resulted from Siri being triggered inadvertently.

The changes to Siri will be implemented in a future iOS update released this fall, which will likely introduce a toggle switch for grading. For more details, read Apple's support document and its related press release.

Top Rated Comments

(View all)
Avatar
14 months ago
I don't recall the last time I used Siri for anything
Score: 17 Votes (Like | Disagree)
Avatar
14 months ago
You should be able to opt out of this.
Score: 13 Votes (Like | Disagree)
Avatar
14 months ago

I don't recall the last time I used Siri for anything

I’m sure you will get criticism on this site for your comment, but I totally agree with you. Like Apple Maps, I repeatedly tried using Siri early in its lifespan, and both were inferior to other options. I just don’t use either anymore. Every now and then I try to make a reminder using Siri on my Apple Watch, half the time waiting for it to “tap me when it’s ready.” Swing and a miss.
Score: 11 Votes (Like | Disagree)
Avatar
14 months ago
And people actually spend 1k on phones only to pretend they will have any privacy. What a time to be alive.
Score: 9 Votes (Like | Disagree)
Avatar
14 months ago

The article says the testing will be opt-in. Even better.

I think you're mixed up, the ability for employees to listen to audio samples will be opt-in. Employees will still be able to read all computer-generated transcripts, and there's no way to opt-out of this.
[doublepost=1567013513][/doublepost]

Did I miss something in the article? What does the opt-in do if they still listen on my recordings?

It's opt-in for only for audio recordings, they can review text transcripts with people that don't opt in.
Score: 7 Votes (Like | Disagree)
Avatar
14 months ago
Pro tip: Assume everything you are doing will eventually be found out. Be upfront with information like this from the beginning. Most people don't care about these things as long as you are clear about what you are doing with data, why it is necessary, and how you can opt out if desired.
Score: 7 Votes (Like | Disagree)

Top Stories

Here's How You Can Download iOS 14 and iPadOS 14 Around the World [It's Out]

Wednesday September 16, 2020 2:36 am PDT by
Apple's official public release of iOS 14 and iPadOS 14 dropped on Wednesday, September 16, just a day after the company released the Golden Master to third-party developers. Also set to be made available to the general public for the first time are watchOS 7 and tvOS 14. Getting Started With iOS 14 Video Click image to watch iOS 14 Getting Started While that's left a lot of developers...

When Will the iPhone 12 Launch? Here's What We Know

Wednesday September 16, 2020 6:12 am PDT by
Yesterday's "Time Flies" Apple event saw the release of the Apple Watch Series 6, Apple Watch SE, iPad 8, and iPad Air 4, but no new iPhone models. Rumors before the event strongly alleged that it would not see the unveiling of new iPhones, with many reports pointing to an October launch. The lack of new iPhone models yesterday seems to confirm that the iPhone 12 lineup will not appear...

Apple Releases iOS 14 and iPadOS 14 With Home Screen Redesign, App Library, Compact UI, Translate App, Scribble Support, App Clips, and More

Wednesday September 16, 2020 12:48 pm PDT by
Apple has released iOS 14 and iPadOS 14, the newest operating system updates designed for the iPhone and iPad. As with all of Apple's software updates, iOS 14 and iPadOS 14 can be downloaded for free. iOS 14 is available on the iPhone 6s and later, while iPadOS 14 is available on the iPad Air 2 and later. The updates are available on all eligible devices over-the-air in the Settings app. To ...

Apple Updates AirPods 2 and AirPods Pro Firmware to Version 3A283

Monday September 14, 2020 11:24 am PDT by
Apple today released new 3A283 firmware updates for the second-generation AirPods and the AirPods Pro. The second-generation AirPods are being updated from the 2D15 firmware they were previously running, while the AirPods Pros are being updated from the 2D27 firmware they had installed previously. Apple does not provide details on what's included in refreshed firmware so we don't know what's ...

Spotify Says Apple One Bundle Will Cause 'Irreparable Harm to Developer Community'

Tuesday September 15, 2020 12:26 pm PDT by
Apple today announced Apple One, a series of new subscription bundles that provide access to various Apple services at a combined monthly price. In response, Spotify sent out statements (via Peter Kafka) to the press decrying Apple's anti-competitive behavior and calling on "competition authorities" to stop Apple before it is able to cause "irreparable harm" to developers.Once again, Apple...

iOS 14, iPadOS 14, watchOS 7, and tvOS 14 Will Be Released September 16

Tuesday September 15, 2020 11:06 am PDT by
Apple today announced that iOS 14, iPadOS 14, watchOS 7, and tvOS 14 will be officially released on Wednesday, September 16. Apple has seeded the final Golden Master beta versions of each update to developers in advance. ‌iOS 14‌ and iPadOS 14 introduce dozens of new features, including a redesigned Home Screen that supports widgets on the iPhone and iPad for the first time. For more...

New AirPods Pro Firmware Introduces Spatial Audio Support and Automatic Switching

Monday September 14, 2020 12:22 pm PDT by
The new 3A283 firmware that Apple released for the AirPods Pro today appears to introduce support for Spatial Audio, a new feature coming to the higher-end AirPods with iOS 14. Multiple reports on Twitter and the MacRumors forums indicate that the firmware update adds a "Spatial Audio" option to the Control Center, which can be activated to enable the feature. Note that using Spatial Audio...

Apple Releases Safari 14 for Mac Ahead of macOS Big Sur Launch

Wednesday September 16, 2020 1:40 pm PDT by
macOS Big Sur didn't launch alongside iOS 14, iPadOS 14, tvOS 14, and watchOS 7 today, with the update coming later this fall, but Apple did release the Safari 14 update for macOS Catalina and macOS Mojave users. Safari 14 brings improved performance, customizable start pages, a Privacy Report to see which cross-site trackers are being blocked, and a new tab bar design that provides tab...

Full Transcript of Apple's 'Time Flies' Event With Apple Watch and iPad Updates

Tuesday September 15, 2020 8:46 am PDT by
Apple's virtual "Time Flies" event kicks off today at 10:00 a.m. Pacific Time, with Apple expected to debut new Apple Watch and iPad models, but it appears we may not see the iPhone 12 until next month. While we're not expecting to see new iPhones today, Apple's software updates for its various platforms are likely nearly ready for launch, so we may be hearing more about them today. Check...

Everything Apple Announced at Today's iPad and Apple Watch Event in Just Seven Minutes

Tuesday September 15, 2020 2:19 pm PDT by
Apple today held its annual September event, but this year was a bit different because no new iPhones were announced. The "Time Flies" event focused on the Apple Watch Series 6 and the iPad Air, and saw the debut of a new Apple One services bundle. Subscribe to the MacRumors YouTube channel for more videos. It took Apple an hour to introduce the new devices, but we've recapped the event in...