Apple Provides Further Clarity on Why It Abandoned Plan to Detect CSAM in iCloud Photos

Apple on Thursday provided its fullest explanation yet for last year abandoning its controversial plan to detect known Child Sexual Abuse Material (CSAM) stored in iCloud Photos.

iCloud General Feature
Apple's statement, shared with Wired and reproduced below, came in response to child safety group Heat Initiative's demand that the company "detect, report, and remove" CSAM from iCloud and offer more tools for users to report such content to the company.

"Child sexual abuse material is abhorrent and we are committed to breaking the chain of coercion and influence that makes children susceptible to it," Erik Neuenschwander, Apple's director of user privacy and child safety, wrote in the company's response to Heat Initiative. He added, though, that after collaborating with an array of privacy and security researchers, digital rights groups, and child safety advocates, the company concluded that it could not proceed with development of a CSAM-scanning mechanism, even one built specifically to preserve privacy.

"Scanning every user's privately stored iCloud data would create new threat vectors for data thieves to find and exploit," Neuenschwander wrote. "It would also inject the potential for a slippery slope of unintended consequences. Scanning for one type of content, for instance, opens the door for bulk surveillance and could create a desire to search other encrypted messaging systems across content types."

In August 2021, Apple announced plans for three new child safety features, including a system to detect known CSAM images stored in ‌iCloud Photos‌, a Communication Safety option that blurs sexually explicit photos in the Messages app, and child exploitation resources for Siri. Communication Safety launched in the U.S. with iOS 15.2 in December 2021 and has since expanded to the U.K., Canada, Australia, and New Zealand, and the ‌Siri‌ resources are also available, but CSAM detection never ended up launching.

Apple initially said CSAM detection would be implemented in an update to iOS 15 and iPadOS 15 by the end of 2021, but the company postponed the feature based on "feedback from customers, advocacy groups, researchers, and others." The plans were criticized by a wide range of individuals and organizations, including security researchers, the Electronic Frontier Foundation (EFF), politicians, policy groups, university researchers, and even some Apple employees.

Apple's latest response to the issue comes at a time when the encryption debate has been reignited by the U.K. government, which is considering plans to amend surveillance legislation that would require tech companies to disable security features like end-to-end encryption without telling the public.

Apple says it will pull services including FaceTime and iMessage in the U.K. if the legislation is passed in its current form.

Note: Due to the political or social nature of the discussion regarding this topic, the discussion thread is located in our Political News forum. All forum members and site visitors are welcome to read and follow the thread, but posting is limited to forum members with at least 100 posts.

Top Rated Comments

Glenny2lappies Avatar
4 weeks ago

I think an on-device, privacy-centric approach could be a good middle ground. Removes the external service and is an enhancement / addition to existing on-device recognition technologies.

For example, if someone used their device to capture such material, or otherwise saved such material to their device, maybe a notice could be displayed "this content could be illegal and causes real harm". It wouldn't remove it, or "report" it external to the device, but it could be at least some way to get someone to think twice about being in possession such horrendous material.
No.

The slippery slope commences. Child abuse, so easy to put in place the infrastructure for censoring.
Then came the clamor for "hate speech". Then Thought Crime.

No. Child abuse is illegal and only a very few people are involved. The wider privacy issue is far more important.

Just read 1984 (the Stephen Fry audiobook is best) to see the end result which we can already see happening.
Score: 56 Votes (Like | Disagree)
Apple Knowledge Navigator Avatar
4 weeks ago
That’s a decent explanation, but I’m baffled that they didn’t think of these things before announcing the feature originally.
Score: 45 Votes (Like | Disagree)
xxray Avatar
4 weeks ago
Still super grateful Apple listened and had the “courage” to walk this back and then even enable end-to-end encryption in iCloud. It really made me lose faith in Apple for a bit when they were pursuing this. I cancelled iCloud and everything.

Yes, CSAM is the absolute worst of humanity, and people who cause/encourage it deserve to be punished. But not at the expense of ruining privacy for the entire rest of the human population.
Score: 44 Votes (Like | Disagree)
Wanted797 Avatar
4 weeks ago

That’s a decent explanation, but I’m baffled that they didn’t think of these things before announcing the feature originally.
They didn’t.

It was a knee jerk reaction that sounded good on paper and I’m assuming Apple corporate bureaucracy (like most companies) meant no one spoke up.
Score: 31 Votes (Like | Disagree)
centauratlas Avatar
4 weeks ago

Is there a deep hidden meaning to this? Basically is Apple saying in not so many words that if they were to create software to scan for CSAM in icloud that it could fall into the hands of data thieves who would exploit it's use and thus to prevent such a thing happening they have no intention of creating the software in the first place? Much like the argument Apple use for not making security backdoors into iphones because they are worried making such a thing will fall into the hands of criminals who would exploit it's use and therefore it is better to say no such thing exists.
Not just data thieves but authoritarians of all stripes - fascist, socialist, communist, monarchist etc - would use it to scan for unacceptable speech and dissent. Then they'd use it to shut down dissent and free speech. Just ask the panda.

See 1984 and Brave New World. They treat them like instructions, not warnings.
Score: 25 Votes (Like | Disagree)
Glenny2lappies Avatar
4 weeks ago
Good on Apple!

First they came for the ('https://en.wikipedia.org/wiki/First_they_came_...')socialists, and I did not speak out—
Because I was not a socialist.

Then they came for the trade unionists, and I did not speak out—
Because I was not a trade unionist.

Then they came for the Jews, and I did not speak out—
Because I was not a Jew.

Then they came for me—and there was no one left to speak for me.



With the rise of populist driven one-trick-pony political movements, it is truly great to see Apple's stance. Privacy is vital as is the right to free speech.
Score: 24 Votes (Like | Disagree)

Popular Stories

iphone se 4 modified flag edges

iPhone SE 4 Details: Action Button, USB-C Port, Face ID, and More

Wednesday September 27, 2023 1:34 pm PDT by
Significant changes are expected to arrive with Apple's fourth-generation iPhone SE, in terms of both design and hardware, MacRumors has learned. The iPhone SE 4, known internally under the codename Ghost, is expected to receive a new design derived almost entirely from the base model iPhone 14. According to our sources, the iPhone SE 4 will use a modified version of the iPhone 14 chassis...
iOS 17

Apple Releases iOS 17.0.2 and iPadOS 17.0.2 for All iPhones and iPads

Tuesday September 26, 2023 12:47 pm PDT by
Apple today released iOS 17.0.2 and iPadOS 17.0.2 updates, with the software coming five days after the releases of iOS 17.0.1 and iPadOS 17.0.1. Today's iOS 17.0.2 and iPadOS 17.0.2 updates arrive as build 21A351 and can be downloaded on eligible iPhones and iPads over-the-air by going to Settings > General > Software Update. Note that iOS 17.0.2 was previously made available for iPhone...
iPhone 15 Pro Lineup Feature

Kuo: iPhone 15 Pro Overheating Issues Likely Due to Thermal Compromises, Not 3nm Node

Tuesday September 26, 2023 9:12 am PDT by
Complaints about heat issues with the iPhone 15 Pro models are not related to TSMC's 3-nanometer node that was used for the A17 Pro chip, according to well-respected Apple analyst Ming-Chi Kuo. Kuo says that overheating could be caused by "compromises made in the thermal system design" that allowed Apple to cut down on the weight of the iPhone 15 Pro models. Kuo says that the reduced heat...
iOS 17

Everything New in iOS 17.1 Beta 1

Wednesday September 27, 2023 1:57 pm PDT by
Just a week after releasing iOS 17, Apple has seeded the first beta of iOS 17.1 to developers. iOS 17.1 adds some features that Apple promised were coming to iOS 17 in the future, plus it refines and improves some existing features. This guide covers everything new in the first iOS 17.1 beta. Apple Music Favorites You can favorite songs, albums, playlists, and artists in the iOS 17.1...
macos sonoma 4

Apple Releases macOS Sonoma With New Widget Features, Safari Updates, Screen Sharing Improvements and More

Tuesday September 26, 2023 10:01 am PDT by
Apple today released macOS 14 Sonoma, the newest version of the operating system that runs on the Mac. macOS Sonoma has been in beta testing for several months, and it is compatible with the 2019 and later iMac, the iMac Pro, the 2018 and later Mac mini, the 2018 and later MacBook Pro, the 2019 and later Mac Pro, and the Mac Studio. The ‌macOS Sonoma update can be downloaded for free on...