Apple Explains How the Photos People Recognition Feature Has Improved in iOS 15

Apple's iOS 15 website lists "improved recognition for individuals" as one of the new Photos features, and in a machine learning blog post shared this week, Apple gave more information on what exactly that means.

ios 15 improved people recognition
Apple says that on-device machine learning improvements have led to significantly better person recognition. The iOS 15 ‌Photos‌ app is able to detect people in extreme poses, people wearing accessories, and people with occluded faces.

To do this, Apple uses a combination of face and upper body to match people whose faces are not visible. Apple's machine learning blog says that the new functionality improves the ‌Photos‌ experience by identifying people in situations where it was previously impossible.

Apple's blog post on recognizing people in photos through on-device machine learning goes into much greater detail on how Apple uses machine learning to identify people while still protecting user privacy, and it's well worth a read for those who are interested in the inner workings of ML features.

Related Roundups: iOS 15, iPadOS 15
Related Forum: iOS 15

Top Rated Comments

Kkspire Avatar
26 weeks ago
Y’all giving your photos to google. Good luck with that. iPhone is using incredible tech on device. Google is going to data centers for processing. No thanks.
Score: 20 Votes (Like | Disagree)
jmh600cbr Avatar
26 weeks ago
can confirm, it works insanely well compared to prior versions. even knows what i looked like as a baby.
Score: 10 Votes (Like | Disagree)
Think|Different Avatar
26 weeks ago
This feature has impressed me, time and time again! You just train it a bit by confirming a face or two and it does the rest. I've been shocked at how it has accurately matched my baby niece as she and her face has changed month to month, year after year, and now she's 3! The little movies with music iOS 15 makes are actually impressive, always dismissed those before.
Score: 9 Votes (Like | Disagree)
_Spinn_ Avatar
26 weeks ago
I love that they do all this locally on device.
Score: 9 Votes (Like | Disagree)
wigby Avatar
26 weeks ago

On device processing is meaningless to me. Google's offerings are server-side therefore doesn't need custom hardware, which is great for equity of access. There are billions of people around the world who can't afford the latest and greatest, at least someone is giving them new features.
You might speak for billions of users shopping for price but you don't speak for their need for privacy and security. Some things are more important than retail price, even to those that cannot afford it.
Score: 8 Votes (Like | Disagree)
gaximus Avatar
26 weeks ago

Still farrrr behind Google
Does Google's Face recognition work on device? or does it get send to a server for processing?
Score: 8 Votes (Like | Disagree)

Related Stories

facebook facial recognition disabled

Facebook Shuttering Facial Recognition System, Will Delete Data From Over a Billion Users

Tuesday November 2, 2021 10:43 am PDT by
Facebook is shutting down its Face Recognition system and will delete the facial data of more than 1 billion of its users, Facebook parent company Meta announced this morning. People who opted in to Face Recognition will no longer be automatically recognized in photos and videos, and their facial recognition templates will be deleted. According to Facebook VP of Artificial Intelligence...
google photos

Google Photos Will Use Machine Learning to Animate Your Still Shots

Wednesday May 19, 2021 1:00 am PDT by
Google Photos is getting a new AI-driven feature that can take two similar pictures in your iPhone's camera roll and turn them into a single moving shot, reports The Verge. Google says the feature achieves this by using machine learning to generate additional frames between the two images, which creates the appearance of movement. If you've taken several shots in succession, for example,...
pixelmator photo iphone

Pixelmator Photo Now Available on iPhone

Thursday December 16, 2021 7:43 am PST by
Pixelmator today announced that its Pixelmator Photo app is now available on the iPhone. Previously limited to the iPad, the photo editing app features over 30 desktop-class color adjustment options, support for over 600 RAW image formats like Apple ProRAW, integration with the Photos app and iCloud Photos, and several AI-powered editing tools. Pixelmator Photo for iPhone also includes batch ...
safari icon blue banner

Safari Bug Allows Websites to Track Your Recent Browsing Activity in Real Time [Updated]

Sunday January 16, 2022 3:37 pm PST by
A bug in WebKit's implementation of a JavaScript API called IndexedDB can reveal your recent browsing history and even your identity, according to a blog post shared on Friday by browser fingerprinting service FingerprintJS. In a nutshell, the bug allows any website that uses IndexedDB to access the names of IndexedDB databases generated by other websites during a user's browsing session....
Facebook Feature

Facebook's New 'Privacy Center' Will Help Educate Users on Data Collection and Privacy Options

Friday January 7, 2022 8:41 am PST by
Facebook today announced a new "Privacy Center" section on its website on the desktop. This new area will offer users a "new place to learn more about our approach to privacy across our apps and technologies" and "provides helpful information about five common privacy topics," Meta announced today in a press release. The new Privacy Center, rolling out to a small pool of Facebook users in...
pixelmator pro 2 31

Pixelmator Pro 2.3 Adds Smart Subject Selection and Background Removal Features, Plus New Select and Mask Tools

Tuesday November 23, 2021 4:53 am PST by
Pixelmator Pro 2.3 went live on the Mac App Store on Tuesday, and the latest major update to the popular image editing app brings a smart new automatic background removal feature, automatic subject selection, new Select and Mask tools, and more. In a blog post announcing the update, Pixelmator's developers say that it's now possible for users to "magically" remove the background from any...
time machine initial backup error

Initial Time Machine Backup Failures Increasingly Being Reported by Mac Users

Wednesday December 8, 2021 3:30 am PST by
Apple's built-in Time Machine backup solution for macOS appears to be causing problems for some Mac users running the latest versions of Monterey and Big Sur, based on a steady trickle of reports on both the MacRumors Forums and Reddit. While some users are complaining of different issues with Time Machine on different Macs and versions of macOS that are hard to replicate, one common...
iOS 15

Everything New in iOS 15.2: App Privacy Report and Auto Call Updates

Wednesday October 27, 2021 11:12 am PDT by
Just a few days after releasing iOS 15.1 and iPadOS 15.1, Apple has seeded the first betas of iOS 15.2 and iPadOS 15.2 to developers for testing purposes, with the update adding promised iOS 15 features like App Privacy Report. App Privacy Report App Privacy Report is one of the iOS 15 additions that Apple showed off at WWDC. It's a new privacy feature that's designed to allow users to see...

Popular Stories

airpodsinear 1

AirPods Save Woman's Life With Feature Everyone Should Know

Friday January 21, 2022 2:13 am PST by
Apple's AirPods have been credited with saving a woman's life after a potentially fatal fall, People reports. When a 60-year-old florist in New Jersey tripped and hit her head in her studio, she lost consciousness and awoke heavily bleeding. With nobody around to call for help, she realized she had her AirPods in, and used a "Hey Siri" command to call 911. An operator was able to stay on the ...
iphone 13 earpods

Apple to Stop Including EarPods With Every iPhone Sold in France From Next Week

Friday January 21, 2022 3:21 am PST by
Apple will no longer include EarPods with every iPhone sold in France, starting on January 24, according to a notice posted by a French carrier (via iGeneration). Apple was previously required to include EarPods in the box with the iPhone due to a French law that required every smartphone sold in the country to come with a "handsfree kit," but the law has now been changed in favor of reducing the ...
peloton tv workout cardio

Apple Floated as Potential Buyer of Peloton

Friday January 21, 2022 6:11 am PST by
Following months of bleak news about Peloton's "precarious state," including the revelation that it has halted production of its bikes and treadmills, Apple is being floated as a potential buyer of Peloton's troubled fitness business. Yesterday, CNBC reported that Peloton will temporarily stop production of its connected fitness products due to a "significant reduction" in consumer demand, a ...
Questionable Design Decisions

Apple's Most Questionable Design Decisions in Recent Memory

Sunday January 23, 2022 2:59 am PST by
Apple has always emphasized the depth of thought that goes into the design of its products. In the foreword to Designed by Apple in California, a photo book released by the company in 2016, Jony Ive explains how Apple strives "to define objects that appear effortless" and "so simple, coherent and inevitable that there could be no rational alternative." But every once in a while even Apple...
Spring 2022 Apple Products Feature

New iPad Air, Macs, and iPhone SE With 5G Likely to Be Announced at Apple Event This Spring

Thursday January 20, 2022 8:32 am PST by
Earlier this week, Bloomberg's Mark Gurman tweeted that Apple "will be holding a spring event" to announce a new iPhone SE and other hardware. In a recent edition of his newsletter, Gurman said the event is likely to occur in March or April. Gurman did not elaborate on what "other hardware" will be announced at Apple's purported spring event, but rumors suggest at least four products are...
Upcoming Products 2022 Feature

Gurman: Apple Preparing 'Widest Array of New Hardware Products in Its History' for Fall

Sunday January 23, 2022 10:32 am PST by
Apple is working on a number of new products that are set to launch this fall, and Bloomberg's Mark Gurman says that it will be "the widest array" of new devices that Apple has introduced in its history. In his latest "Power On" newsletter, Gurman explains that Apple is working on four new iPhones (5G iPhone SE, iPhone 14, iPhone 14 Pro, and iPhone 14 Pro Max), an updated low-end MacBook Pro,...
apple watch series 7 aluminum colors yellowbg

Apple Watch Charging Bug Fixed in watchOS 8.4 Release Candidate

Thursday January 20, 2022 4:01 pm PST by
The watchOS 8.4 release candidate that was seeded to developers and beta testers this morning addresses an ongoing bug that could cause some Apple Watch chargers not to work properly with the Apple Watch. Back in December, we reported on a growing number of charging issues that Apple Watch Series 7 owners were facing. Since watchOS 8.3, there have been a number of complaints about...
safari icon blue banner

macOS Monterey 12.2 and iOS 15.3 Release Candidates Fix Safari Bug That Leaks Browsing Activity

Thursday January 20, 2022 1:30 pm PST by
The macOS Monterey 12.2 and iOS 15.3 release candidates that came out today appear to address a Safari bug that could cause your recent browsing history and details about your identity to be leaked to malicious entities. As shared last week by browser fingerprinting service FingerprintJS, there is an issue with the WebKit implementation of the IndexedDB JavaScript API. Any website that uses...
apple college discounts

Apple Walks Back UNiDAYS Verification Requirement for U.S. Education Store

Friday January 21, 2022 12:43 pm PST by
Earlier this week, Apple began requiring that customers taking advantage of educational discounts in the United States verify their status as a teacher, student, or school staff member through UNiDAYS. The requirement was a major change as Apple had never asked customers to go through a verification process in the United States before, and now, just three days after verification was added,...