Apple Explains How the Photos People Recognition Feature Has Improved in iOS 15

Apple's iOS 15 website lists "improved recognition for individuals" as one of the new Photos features, and in a machine learning blog post shared this week, Apple gave more information on what exactly that means.

ios 15 improved people recognition
Apple says that on-device machine learning improvements have led to significantly better person recognition. The iOS 15 ‌Photos‌ app is able to detect people in extreme poses, people wearing accessories, and people with occluded faces.

To do this, Apple uses a combination of face and upper body to match people whose faces are not visible. Apple's machine learning blog says that the new functionality improves the ‌Photos‌ experience by identifying people in situations where it was previously impossible.

Apple's blog post on recognizing people in photos through on-device machine learning goes into much greater detail on how Apple uses machine learning to identify people while still protecting user privacy, and it's well worth a read for those who are interested in the inner workings of ML features.

Related Forum: iOS 15

Popular Stories

iPhone 17 Plus Feature

iPhone 17 Lineup Specs Detail Display Upgrade and New High-End Model

Monday July 22, 2024 4:33 am PDT by
Key details about the overall specifications of the iPhone 17 lineup have been shared by the leaker known as "Ice Universe," clarifying several important aspects of next year's devices. Reports in recent months have converged in agreement that Apple will discontinue the "Plus" iPhone model in 2025 while introducing an all-new iPhone 17 "Slim" model as an even more high-end option sitting...
iPhone SE 4 Vertical Camera Feature

iPhone SE 4 Production Will Reportedly Begin Ramping Up in October

Tuesday July 23, 2024 2:00 pm PDT by
Following nearly two years of rumors about a fourth-generation iPhone SE, The Information today reported that Apple suppliers are finally planning to begin ramping up mass production of the device in October of this year. If accurate, that timeframe would mean that the next iPhone SE would not be announced alongside the iPhone 16 series in September, as expected. Instead, the report...
Generic iPhone 17 Feature With Full Width Dynamic Island

Kuo: Ultra-Thin iPhone 17 to Feature A19 Chip, Single Rear Camera, Semi-Titanium Frame, and More

Wednesday July 24, 2024 9:06 am PDT by
Apple supply chain analyst Ming-Chi Kuo today shared alleged specifications for a new ultra-thin iPhone 17 model rumored to launch next year. Kuo expects the device to be equipped with a 6.6-inch display with a current-size Dynamic Island, a standard A19 chip rather than an A19 Pro chip, a single rear camera, and an Apple-designed 5G chip. He also expects the device to have a...
iPhone 17 Plus Feature Purple

These 5 Features Will Make the iPhone 17 the Biggest Update in Years

Monday July 22, 2024 4:02 pm PDT by
The upcoming iPhone 16 models that we're expecting to see in September are going to be quite similar to the iPhone 15 models, but rumors suggest that Apple is making big changes in 2025. We've been hearing hints of an all-new device in the iPhone lineup, and it may be the most expensive iPhone Apple has offered to date. New 'Slim' Design Rumors have taken to referring to the new iPhone 17...
iOS 18 on iPhone Feature

Everything New in iOS 18 Beta 4

Tuesday July 23, 2024 1:08 pm PDT by
Apple released the fourth beta of iOS 18 today, introducing small changes to a number of features throughout the operating system. There are no big additions in this beta, but Apple is continuing to refine existing settings and design choices. Apple plans to continue updating iOS 18 over the next few months, with the update set to be released this fall. We've rounded up all of the changes...
iPhone SE 4 Thumb 1

iPhone SE 4 Rumored to Launch Early Next Year With OLED Display, 48MP Camera, and More

Monday July 22, 2024 7:22 am PDT by
The fourth-generation iPhone SE will offer a series of major upgrades over the current model, the leaker known as "Ice Universe" claims. The information was listed in a post on Weibo, which also detailed the specifications of the iPhone 17 lineup. As previously rumored, the fourth-generation iPhone SE is expected to feature Face ID and USB-C, marking a major upgrade from current and previous ...
iPhone 17 Plus Feature Purple

iPhone 17 Rumored to Feature Mechanical Aperture

Tuesday July 23, 2024 9:32 am PDT by
Apple is planning to release at least one iPhone 17 model next year with mechanical aperture, according to a report published today by The Information. The mechanical system would allow users to adjust the size of the iPhone 17's aperture, which refers to the opening of the camera lens through which light enters. All existing iPhone camera lenses have fixed apertures, but some Android...

Top Rated Comments

Kkspire Avatar
39 months ago
Y’all giving your photos to google. Good luck with that. iPhone is using incredible tech on device. Google is going to data centers for processing. No thanks.
Score: 19 Votes (Like | Disagree)
jmh600cbr Avatar
39 months ago
can confirm, it works insanely well compared to prior versions. even knows what i looked like as a baby.
Score: 10 Votes (Like | Disagree)
Think|Different Avatar
39 months ago
This feature has impressed me, time and time again! You just train it a bit by confirming a face or two and it does the rest. I've been shocked at how it has accurately matched my baby niece as she and her face has changed month to month, year after year, and now she's 3! The little movies with music iOS 15 makes are actually impressive, always dismissed those before.
Score: 9 Votes (Like | Disagree)
_Spinn_ Avatar
39 months ago
I love that they do all this locally on device.
Score: 9 Votes (Like | Disagree)
wigby Avatar
39 months ago

On device processing is meaningless to me. Google's offerings are server-side therefore doesn't need custom hardware, which is great for equity of access. There are billions of people around the world who can't afford the latest and greatest, at least someone is giving them new features.
You might speak for billions of users shopping for price but you don't speak for their need for privacy and security. Some things are more important than retail price, even to those that cannot afford it.
Score: 8 Votes (Like | Disagree)
gaximus Avatar
39 months ago

Still farrrr behind Google
Does Google's Face recognition work on device? or does it get send to a server for processing?
Score: 8 Votes (Like | Disagree)