Apple Explains How the Photos People Recognition Feature Has Improved in iOS 15

Apple's iOS 15 website lists "improved recognition for individuals" as one of the new Photos features, and in a machine learning blog post shared this week, Apple gave more information on what exactly that means.

ios 15 improved people recognition
Apple says that on-device machine learning improvements have led to significantly better person recognition. The iOS 15 ‌Photos‌ app is able to detect people in extreme poses, people wearing accessories, and people with occluded faces.

To do this, Apple uses a combination of face and upper body to match people whose faces are not visible. Apple's machine learning blog says that the new functionality improves the ‌Photos‌ experience by identifying people in situations where it was previously impossible.

Apple's blog post on recognizing people in photos through on-device machine learning goes into much greater detail on how Apple uses machine learning to identify people while still protecting user privacy, and it's well worth a read for those who are interested in the inner workings of ML features.

Related Forum: iOS 15

Top Rated Comments

Kkspire Avatar
36 months ago
Y’all giving your photos to google. Good luck with that. iPhone is using incredible tech on device. Google is going to data centers for processing. No thanks.
Score: 19 Votes (Like | Disagree)
jmh600cbr Avatar
36 months ago
can confirm, it works insanely well compared to prior versions. even knows what i looked like as a baby.
Score: 10 Votes (Like | Disagree)
Think|Different Avatar
36 months ago
This feature has impressed me, time and time again! You just train it a bit by confirming a face or two and it does the rest. I've been shocked at how it has accurately matched my baby niece as she and her face has changed month to month, year after year, and now she's 3! The little movies with music iOS 15 makes are actually impressive, always dismissed those before.
Score: 9 Votes (Like | Disagree)
_Spinn_ Avatar
36 months ago
I love that they do all this locally on device.
Score: 9 Votes (Like | Disagree)
wigby Avatar
36 months ago

On device processing is meaningless to me. Google's offerings are server-side therefore doesn't need custom hardware, which is great for equity of access. There are billions of people around the world who can't afford the latest and greatest, at least someone is giving them new features.
You might speak for billions of users shopping for price but you don't speak for their need for privacy and security. Some things are more important than retail price, even to those that cannot afford it.
Score: 8 Votes (Like | Disagree)
gaximus Avatar
36 months ago

Still farrrr behind Google
Does Google's Face recognition work on device? or does it get send to a server for processing?
Score: 8 Votes (Like | Disagree)

Popular Stories

maxresdefault

Apple Announces 'Let Loose' Event on May 7 Amid Rumors of New iPads

Tuesday April 23, 2024 7:11 am PDT by
Apple has announced it will be holding a special event on Tuesday, May 7 at 7 a.m. Pacific Time (10 a.m. Eastern Time), with a live stream to be available on Apple.com and on YouTube as usual. The event invitation has a tagline of "Let Loose" and shows an artistic render of an Apple Pencil, suggesting that iPads will be a focus of the event. Subscribe to the MacRumors YouTube channel for more ...
Apple Silicon AI Optimized Feature Siri

Apple Releases Open Source AI Models That Run On-Device

Wednesday April 24, 2024 3:39 pm PDT by
Apple today released several open source large language models (LLMs) that are designed to run on-device rather than through cloud servers. Called OpenELM (Open-source Efficient Language Models), the LLMs are available on the Hugging Face Hub, a community for sharing AI code. As outlined in a white paper [PDF], there are eight total OpenELM models, four of which were pre-trained using the...
iOS 18 Siri Integrated Feature

iOS 18 Rumored to Add These 10 New Features to Your iPhone

Wednesday April 24, 2024 2:05 pm PDT by
Apple is set to unveil iOS 18 during its WWDC keynote on June 10, so the software update is a little over six weeks away from being announced. Below, we recap rumored features and changes planned for the iPhone with iOS 18. iOS 18 will reportedly be the "biggest" update in the iPhone's history, with new ChatGPT-inspired generative AI features, a more customizable Home Screen, and much more....
Apple Vision Pro Dual Loop Band Orange Feature 2

Apple Cuts Vision Pro Shipments as Demand Falls 'Sharply Beyond Expectations'

Tuesday April 23, 2024 9:44 am PDT by
Apple has dropped the number of Vision Pro units that it plans to ship in 2024, going from an expected 700 to 800k units to just 400k to 450k units, according to Apple analyst Ming-Chi Kuo. Orders have been scaled back before the Vision Pro has launched in markets outside of the United States, which Kuo says is a sign that demand in the U.S. has "fallen sharply beyond expectations." As a...
iPad And Calculator App Feature 1

Apple Finally Plans to Release a Calculator App for iPad Later This Year

Tuesday April 23, 2024 9:08 am PDT by
Apple is finally planning a Calculator app for the iPad, over 14 years after launching the device, according to a source familiar with the matter. iPadOS 18 will include a built-in Calculator app for all iPad models that are compatible with the software update, which is expected to be unveiled during the opening keynote of Apple's annual developers conference WWDC on June 10. AppleInsider...