Apple Explains How the Photos People Recognition Feature Has Improved in iOS 15

Apple's iOS 15 website lists "improved recognition for individuals" as one of the new Photos features, and in a machine learning blog post shared this week, Apple gave more information on what exactly that means.

ios 15 improved people recognition
Apple says that on-device machine learning improvements have led to significantly better person recognition. The iOS 15 ‌Photos‌ app is able to detect people in extreme poses, people wearing accessories, and people with occluded faces.

To do this, Apple uses a combination of face and upper body to match people whose faces are not visible. Apple's machine learning blog says that the new functionality improves the ‌Photos‌ experience by identifying people in situations where it was previously impossible.

Apple's blog post on recognizing people in photos through on-device machine learning goes into much greater detail on how Apple uses machine learning to identify people while still protecting user privacy, and it's well worth a read for those who are interested in the inner workings of ML features.

Related Forum: iOS 15

Top Rated Comments

Kkspire Avatar
28 months ago
Y’all giving your photos to google. Good luck with that. iPhone is using incredible tech on device. Google is going to data centers for processing. No thanks.
Score: 19 Votes (Like | Disagree)
jmh600cbr Avatar
28 months ago
can confirm, it works insanely well compared to prior versions. even knows what i looked like as a baby.
Score: 10 Votes (Like | Disagree)
Think|Different Avatar
28 months ago
This feature has impressed me, time and time again! You just train it a bit by confirming a face or two and it does the rest. I've been shocked at how it has accurately matched my baby niece as she and her face has changed month to month, year after year, and now she's 3! The little movies with music iOS 15 makes are actually impressive, always dismissed those before.
Score: 9 Votes (Like | Disagree)
_Spinn_ Avatar
28 months ago
I love that they do all this locally on device.
Score: 9 Votes (Like | Disagree)
wigby Avatar
28 months ago

On device processing is meaningless to me. Google's offerings are server-side therefore doesn't need custom hardware, which is great for equity of access. There are billions of people around the world who can't afford the latest and greatest, at least someone is giving them new features.
You might speak for billions of users shopping for price but you don't speak for their need for privacy and security. Some things are more important than retail price, even to those that cannot afford it.
Score: 8 Votes (Like | Disagree)
gaximus Avatar
28 months ago

Still farrrr behind Google
Does Google's Face recognition work on device? or does it get send to a server for processing?
Score: 8 Votes (Like | Disagree)

Popular Stories

iOS 17

Apple Releases iOS 17.0.1 and iPadOS 17.0.1 With Bug Fixes, Plus iOS 17.0.2 for iPhone 15 Models

Thursday September 21, 2023 10:28 am PDT by
Apple today released iOS 17.0.1 and iPadOS 17.0.1 updates for the iPhone and the iPad, adding bug fixes to the new software. The iOS 17.0.1 and iPadOS 17.0.1 updates come just a few days after Apple launched iOS 17 and iPadOS 17. The software, which is build 21A340, can be downloaded on eligible iPhones and iPads over-the-air by going to Settings > General > Software Update. There is a...
iPhone 16 Mock Header With Dynamic Island

Skipping the iPhone 15 Pro? Here's What's Rumored for iPhone 16 Pro

Friday September 22, 2023 9:29 am PDT by
Are you skipping the iPhone 15 Pro and waiting another year to upgrade? If so, we already have some iPhone 16 Pro rumors for you. Below, we recap new features rumored for the iPhone 16 Pro models so far:Larger displays: The iPhone 16 Pro and iPhone 16 Pro Max will be equipped with larger 6.3-inch and 6.9-inch displays, respectively, according to Ross Young, CEO of Display Supply Chain...
Update Your iPhone 15 to iOS 17

Warning: Update Your iPhone 15 to iOS 17.0.2 Before Transferring Data From Another iPhone

Friday September 22, 2023 6:36 am PDT by
If you are unboxing an iPhone 15, iPhone 15 Plus, iPhone 15 Pro, or iPhone 15 Pro Max today, make sure to update the device to iOS 17.0.2 before transferring data to the device from another iPhone, or else you might encounter issues. iOS 17.0.2 is only available for the iPhone 15 lineup. Apple says the update fixes an issue that may prevent transferring data directly from another iPhone...
Apple Watch Ultra 2 double tap gesture 230912

watchOS 10.1 to Enable Apple Watch's New 'Double Tap' Gesture

Thursday September 21, 2023 12:52 pm PDT by
The new Double Tap gesture for the Apple Watch Series 9 and the Apple Watch Ultra 2 will be enabled starting with watchOS 10.1, according to Marques Brownlee, host of the popular tech-focused YouTube channel MKBHD. The first beta of watchOS 10.1 will likely be available by next week, and Apple announced that the software update will be released next month. Brownlee shared his impressions...
emojipedia 15 1 emoji

Emoji Coming to Future iOS 17 Update Include Shaking Head, Brown Mushroom, Lime, Phoenix and More

Tuesday September 19, 2023 12:43 pm PDT by
As Apple was announcing new iPhone models last week, the Unicode Consortium was officially approving new emoji characters that are set to be added to smartphones starting in 2024. Mockup of new emoji from Emojipedia Approved Unicode 15.1 emoji include phoenix, lime, an edible mushroom, shaking head vertically (as in a "yes" nod), shaking head horizontally (a "no" head shake), and broken...
iPhone 15 Pro Fingerprints

Apple Says Fingerprints Can 'Temporarily Alter the Color' of iPhone 15 Pro's Titanium Frame

Thursday September 21, 2023 2:48 pm PDT by
In a support document updated today, Apple indicates that fingerprints might "temporarily alter the color" of the titanium frame on the iPhone 15 Pro and iPhone 15 Pro Max. Fortunately, Apple says this is not a permanent condition, as the fingerprints can be wiped off just like on any other iPhone to restore a clean finish. "For iPhone 15 Pro and iPhone 15 Pro Max, the oil from your skin...