Apple Explains How the Photos People Recognition Feature Has Improved in iOS 15

Apple's iOS 15 website lists "improved recognition for individuals" as one of the new Photos features, and in a machine learning blog post shared this week, Apple gave more information on what exactly that means.

ios 15 improved people recognition
Apple says that on-device machine learning improvements have led to significantly better person recognition. The iOS 15 ‌Photos‌ app is able to detect people in extreme poses, people wearing accessories, and people with occluded faces.

To do this, Apple uses a combination of face and upper body to match people whose faces are not visible. Apple's machine learning blog says that the new functionality improves the ‌Photos‌ experience by identifying people in situations where it was previously impossible.

Apple's blog post on recognizing people in photos through on-device machine learning goes into much greater detail on how Apple uses machine learning to identify people while still protecting user privacy, and it's well worth a read for those who are interested in the inner workings of ML features.

Related Roundups: iOS 15, iPadOS 15
Related Forum: iOS 15

Top Rated Comments

Kkspire Avatar
14 months ago
Y’all giving your photos to google. Good luck with that. iPhone is using incredible tech on device. Google is going to data centers for processing. No thanks.
Score: 20 Votes (Like | Disagree)
jmh600cbr Avatar
14 months ago
can confirm, it works insanely well compared to prior versions. even knows what i looked like as a baby.
Score: 10 Votes (Like | Disagree)
Think|Different Avatar
14 months ago
This feature has impressed me, time and time again! You just train it a bit by confirming a face or two and it does the rest. I've been shocked at how it has accurately matched my baby niece as she and her face has changed month to month, year after year, and now she's 3! The little movies with music iOS 15 makes are actually impressive, always dismissed those before.
Score: 9 Votes (Like | Disagree)
_Spinn_ Avatar
14 months ago
I love that they do all this locally on device.
Score: 9 Votes (Like | Disagree)
wigby Avatar
14 months ago

On device processing is meaningless to me. Google's offerings are server-side therefore doesn't need custom hardware, which is great for equity of access. There are billions of people around the world who can't afford the latest and greatest, at least someone is giving them new features.
You might speak for billions of users shopping for price but you don't speak for their need for privacy and security. Some things are more important than retail price, even to those that cannot afford it.
Score: 8 Votes (Like | Disagree)
gaximus Avatar
14 months ago

Still farrrr behind Google
Does Google's Face recognition work on device? or does it get send to a server for processing?
Score: 8 Votes (Like | Disagree)

Related Stories

time machine initial backup error

Initial Time Machine Backup Failures Increasingly Being Reported by Mac Users

Wednesday December 8, 2021 3:30 am PST by
Apple's built-in Time Machine backup solution for macOS appears to be causing problems for some Mac users running the latest versions of Monterey and Big Sur, based on a steady trickle of reports on both the MacRumors Forums and Reddit. While some users are complaining of different issues with Time Machine on different Macs and versions of macOS that are hard to replicate, one common...
Twitter Feature

Twitter Close Friends Feature in Beta Now Called 'Flock' With 150-Person Limit

Tuesday January 25, 2022 4:15 am PST by
Twitter continues to work on a new feature that lets users post certain tweets to a limited number of close friends in a parallel timeline on the social media platform. Previously floated in July 2021 as "Trusted Friends," the feature is now called "Flock," and will allow users to limit their audience for specific content to no more than 150 people, according to screens uncovered by mobile...
google photos

Google Photos Will Use Machine Learning to Animate Your Still Shots

Wednesday May 19, 2021 1:00 am PDT by
Google Photos is getting a new AI-driven feature that can take two similar pictures in your iPhone's camera roll and turn them into a single moving shot, reports The Verge. Google says the feature achieves this by using machine learning to generate additional frames between the two images, which creates the appearance of movement. If you've taken several shots in succession, for example,...
twitter downvote

Twitter Expands Downvote Button Test Worldwide

Friday February 4, 2022 4:01 am PST by
Twitter is globally expanding its testing of a new "dislike" or thumbs down button for tweets, which is designed to let people downvote replies on the social media platform. The company announced the global expansion of the test on Thursday, saying it had "learned a lot" about the downvoting option in its initial limited testing: We learned a lot about the types of replies you don't find...
General iOS 15

Apple Seeds Second Release Candidate Version of iOS 15.2 for iPhone 13 Models to Developers and Public Beta Testers

Friday December 10, 2021 10:12 am PST by
Apple today seeded the second RC version of an upcoming iOS 15.2 update to developers and public beta testers, less than a week after seeding the first RC and six weeks after the launch of iOS 15.1. iOS 15.2 beta can be downloaded through the Apple Developer Center or over the air after the proper profile has been installed on an iPhone or an iPad. Public beta testers can also download the...
iOS 15

Everything New in iOS 15.2: App Privacy Report and Auto Call Updates

Wednesday October 27, 2021 11:12 am PDT by
Just a few days after releasing iOS 15.1 and iPadOS 15.1, Apple has seeded the first betas of iOS 15.2 and iPadOS 15.2 to developers for testing purposes, with the update adding promised iOS 15 features like App Privacy Report. App Privacy Report App Privacy Report is one of the iOS 15 additions that Apple showed off at WWDC. It's a new privacy feature that's designed to allow users to see...
apple amsterdam

Hostage Situation Reported at Apple Store in Amsterdam [Updated]

Tuesday February 22, 2022 10:04 am PST by
Police officers are surrounding Apple Amsterdam in Leidseplein following reports that a gunman entered the store. A video shared on Twitter showed a man in a balaclava holding a gun while gripping a possible hostage, and Amsterdam police have confirmed that there is indeed a hostage situation. People in surrounding buildings have been ordered to stay indoors, and the area around the store...
maxresdefault

Apple Releases iOS 15.2 With App Privacy Report, Legacy Contacts, Hide My Email Improvements and More

Monday December 13, 2021 9:48 am PST by
Apple today released iOS 15.2 and iPadOS 15.2, the second major updates to the iOS and iPadOS 15 operating systems that were released in September 2021. iOS 15.2 comes more than a month after the launch of iOS 15.1. Subscribe to the MacRumors YouTube channel for more videos. The iOS and iPadOS 15.2 updates can be downloaded for free and the software is available on all eligible devices...

Popular Stories

iPhone 14 Dummies 1 Feature

Everything Rumored for Apple's September Event: iPhone 14, Apple Watch Pro and More

Friday August 12, 2022 2:34 pm PDT by
There's just about a month to go until Apple holds its annual September event focusing on new iPhone and Apple Watch models. We thought we'd take a quick look at everything that's rumored for Apple's September event to give MacRumors readers a rundown on what to expect when the first fall event rolls around. iPhone 14 The iPhone 14 can probably be described more as an "iPhone 13S" because...
airpods pro black background

AirPods Pro 2: Five New Features and Improvements to Expect

Sunday August 14, 2022 3:28 pm PDT by
Apple's second-generation AirPods Pro are finally nearing launch, with a release expected later this year. If you are considering upgrading to the new AirPods Pro once they are released, keep reading for a list of five new features to expect. In addition to all-new features, the second-generation AirPods Pro will likely adopt some features added to the standard AirPods last year. H2 Chip ...
z fold 4 1

Hands-On With Samsung's Latest Foldable Smartphones, the Galaxy Z Fold and Z Flip

Friday August 12, 2022 12:46 pm PDT by
Samsung this week launched its fourth-generation foldable devices, the $1,000 Galaxy Z Flip and the $1,800 Galaxy Z Fold. Though there's no sign of a comparable Apple foldable device on the horizon, rumors suggest prototypes are in the works, so we thought we'd take a look at Samsung's newest smartphones to see what Apple needs to measure up to when a foldable iPhone does come out. Subscribe ...
top stories 13aug2022

Top Stories: New Battery Percentage Icon in iOS 16, USB-C AirPods Rumor, and More

Saturday August 13, 2022 6:00 am PDT by
This week brought some shocking news for iOS 16 beta testers, with Apple bringing back the iPhone battery percentage to the status bar after a number of years. Other news and rumors this week included word that Apple has started recording portions of its media event planned for next month to introduce the iPhone 14 and Apple Watch Series 8, claims about iPhone 14 Pro pricing and Apple's...
iCloud General Feature

Apple Remains Silent About Plans to Detect Known CSAM Stored in iCloud Photos

Saturday August 13, 2022 1:52 pm PDT by
It has now been over a year since Apple announced plans for three new child safety features, including a system to detect known Child Sexual Abuse Material (CSAM) images stored in iCloud Photos, an option to blur sexually explicit photos in the Messages app, and child exploitation resources for Siri. The latter two features are now available, but Apple remains silent about its plans for the CSAM...
apple watch se

Apple Watch SE vs. Apple Watch Series 8: New Features to Expect If You've Waited to Upgrade

Monday August 15, 2022 2:44 am PDT by
The Apple Watch SE was announced in September 2020 and has been a popular Apple Watch model for customers looking for their first smartwatch or an affordable Apple Watch. Apple Watch SE customers may be wondering, however, what's in store for them with the upcoming Apple Watch Series 8 and what new features they can expect. Continue reading to find out. Apple Watch SE vs. Apple Watch Series ...