Apple Will Continue to Review Computer-Generated Siri Transcripts Regardless of Opt-In Status

Apple has published a new support document with several questions and answers about its Siri quality evaluation process, also known as grading, to address any privacy concerns that customers may have.


As a refresher, it was recently discovered that Apple hired contractors to listen to a small percentage of anonymized Siri recordings — and review their corresponding computer-generated transcripts — to measure how well Siri was responding and to improve the assistant's accuracy and reliability.

The human review process likely existed for quite some time, but it was never mentioned in Apple's privacy policy, and it only became the subject of controversy last month after The Guardian reported that contractors "regularly" heard "confidential details" while listening to the Siri audio recordings.

Following that report, Apple quickly suspended its grading program and conducted a review of its policies. Apple has since apologized over the matter and says it will resume the evaluation process in the fall on an opt-in basis with improved privacy measures, including no longer retaining audio recordings.

In its FAQ, however, Apple says it will continue to review anonymized computer-generated transcripts of Siri interactions, even from users who do not opt in. The only way to avoid this will be to disable Siri entirely:

Is the only way for Siri not to retain my audio recordings and transcripts to disable Siri?

By default, Apple will no longer retain audio of your Siri requests, starting with a future software release in fall 2019. Computer-generated transcriptions of your audio requests may be used to improve Siri. These transcriptions are associated with a random identifier, not your Apple ID, for up to six months. If you do not want transcriptions of your Siri audio recordings to be retained, you can disable Siri and Dictation in Settings.

Prior to suspending grading, Apple says it reviewed less than 0.2 percent of Siri interactions and corresponding computer-generated transcripts.

As for users that do opt in, Apple says it has updated its review process to limit graders' exposure to audio recordings that are determined to have resulted from Siri being triggered inadvertently. Apple is also making changes to minimize the amount of data that the graders have access to:

When you say you are minimizing the amount of data reviewers have access to, what does that mean? What will they still be able to hear?

We are making changes to the human grading process to further minimize the amount of data reviewers have access to, so that they see only the data necessary to effectively do their work. For example, the names of the devices and rooms you setup in the Home app will only be accessible by the reviewer if the request being graded involves controlling devices in the home.

Apple says it will work to delete any recording which is determined to have resulted from Siri being triggered inadvertently.

The changes to Siri will be implemented in a future iOS update released this fall, which will likely introduce a toggle switch for grading. For more details, read Apple's support document and its related press release.

Top Rated Comments

(View all)
Avatar
11 months ago
I don't recall the last time I used Siri for anything
Score: 17 Votes (Like | Disagree)
Avatar
11 months ago
You should be able to opt out of this.
Score: 13 Votes (Like | Disagree)
Avatar
11 months ago

I don't recall the last time I used Siri for anything

I’m sure you will get criticism on this site for your comment, but I totally agree with you. Like Apple Maps, I repeatedly tried using Siri early in its lifespan, and both were inferior to other options. I just don’t use either anymore. Every now and then I try to make a reminder using Siri on my Apple Watch, half the time waiting for it to “tap me when it’s ready.” Swing and a miss.
Score: 11 Votes (Like | Disagree)
Avatar
11 months ago
And people actually spend 1k on phones only to pretend they will have any privacy. What a time to be alive.
Score: 9 Votes (Like | Disagree)
Avatar
11 months ago

The article says the testing will be opt-in. Even better.

I think you're mixed up, the ability for employees to listen to audio samples will be opt-in. Employees will still be able to read all computer-generated transcripts, and there's no way to opt-out of this.
[doublepost=1567013513][/doublepost]

Did I miss something in the article? What does the opt-in do if they still listen on my recordings?

It's opt-in for only for audio recordings, they can review text transcripts with people that don't opt in.
Score: 7 Votes (Like | Disagree)
Avatar
11 months ago
Pro tip: Assume everything you are doing will eventually be found out. Be upfront with information like this from the beginning. Most people don't care about these things as long as you are clear about what you are doing with data, why it is necessary, and how you can opt out if desired.
Score: 7 Votes (Like | Disagree)

Top Stories

iPhone 12 Sizes Compared with iPhone SE, 7, 8, SE 2, X, 11, 11 Pro and 11 Pro Max [Update]

Tuesday July 7, 2020 6:49 pm PDT by
Apple is planning on launching the iPhone 12 this fall which is rumored to be coming in 3 different sizes: 5.4", 6.1" and 6.7". The middle size (6.1") matches up with the currently shipping iPhone 11, but the other two sizes will be entirely new. Over the weekend, there was some excitement about how well the new 5.4" iPhone 12 compares to the original iPhone SE. Those who have been hoping...

Everything New in iOS 14 Beta 2: New Calendar Icon, Files Widget and More

Tuesday July 7, 2020 11:38 am PDT by
Apple today released the second beta of iOS 14 to developers for testing purposes, tweaking and refining some of the features that are coming in the update. Below, we've rounded up all of the changes that we found in the second beta. - Calendar icon - There's a new Calendar app icon in iOS 14 beta 2, with the day of the week abbreviated rather than spelled out. - Clock icon - The clock...

Hands On With iPhone 12 Models Showing New Sizes and Design

Monday July 6, 2020 2:04 pm PDT by
Ahead of the launch of new iPhones we often see dummy models created based on leaked schematics and specifications, with those models designed to let case makers create cases for the new devices ahead of their release. We got our hands on a set of dummy models that represent the iPhone 12 lineup, giving us our first close look at the iPhone 4-style design and the different size options. Subscri ...

Developer's Visual Comparison of macOS Catalina and Big Sur Offers Closer Look at Apple's UI Redesign for Macs

Tuesday July 7, 2020 4:00 am PDT by
macOS 11 Big Sur is the next major release of Apple's operating system for Mac, and following its preview at WWDC, one of the biggest discussions has revolved around the all-new user interface redesign. Developers are still learning what the impact the new UI will have on their apps, and with that in mind, app designer Andrew Denty has compiled an extensive visual comparison of the user...

Analyst Believes iPhone 12 Pricing Will Start $50 Higher Even Without EarPods or Charger in Box

Wednesday July 8, 2020 9:35 am PDT by
Despite multiple reports indicating that Apple will not include EarPods or a wall charger with iPhone 12 models this year, one analyst believes that pricing will still increase slightly compared to the iPhone 11 lineup. In a research note provided to MacRumors, analyst Jeff Pu forecasted that iPhone 12 pricing will start at $749 for a new 5.4-inch model, an increase of $50 over the base...

14-Inch MacBook Pro With Mini-LED Display Expected to Enter Production in 2021

Wednesday July 8, 2020 7:51 am PDT by
Apple suppliers will begin competing to win manufacturing orders for new 14-inch and 16-inch MacBook Pro models with Mini-LED displays in the first quarter of 2021, according to Taiwanese research firm TrendForce. Rumors of a 14-inch MacBook Pro have surfaced since Apple replaced the 15-inch MacBook Pro with a new 16-inch model last year. Apple analyst Ming-Chi Kuo has previously said that...

Apple Seeds First Betas of iOS 14 and iPadOS 14 to Public Beta Testers

Thursday July 9, 2020 10:14 am PDT by
Apple today seeded the first public betas of upcoming iOS and iPadOS 14 updates to its public beta testing group, two weeks after first providing the updates to developers after the WWDC keynote and a day after seeding the second developer betas. Public beta testers who have signed up for Apple's beta testing program can download the iOS/‌iPadOS‌ 14 updates over the air after installing ...

Apple's Arm-Based Macs With Apple Silicon Chips Will Support Thunderbolt

Wednesday July 8, 2020 3:14 pm PDT by
Apple is working on Macs that use its custom Apple-designed Apple Silicon chips instead of Intel chips, but Apple has committed to continuing to support Thunderbolt, reports The Verge. In a statement, an Apple spokesperson said that Apple's upcoming machines will offer support for Intel's Thunderbolt USB-C standard. "Over a decade ago, Apple partnered with Intel to design and develop...

Apple Cuts iPhone Trade-In Values as iPhone 12 Launch Nears

Tuesday July 7, 2020 7:46 am PDT by
With just two months to go until the usual timeframe for Apple's iPhone launch events, Apple is cutting back on maximum trade-in values of previous-generation iPhones for those looking to upgrade to a new model. Maximum values on more recent models have dropped by $30–$50, while older models have generally dropped by $5–$20 with a few models seeing no change in value.iPhone XS Max: $500 to...

Some iPhone Users Report Significant Battery Drain Due to Music App Background Activity in iOS 13.5.1

Wednesday July 8, 2020 1:49 am PDT by
A significant minority of iPhone users have taken to Apple's Support Communities and Reddit to report battery drain issues largely related to the Music app and high levels of background activity. Hundreds of users, many running iOS 13.5.1 on devices both new and old, are experiencing rapid battery drain when the Music app is not in use. In some cases, the background activity occurs over...