New Photos App Detects 4,432 Total Searchable Objects and 7 Facial Expressions [Updated]

One of Apple's first party apps that's getting a makeover in iOS 10 and macOS Sierra is Photos, bringing intensive new facial recognition and "Siri intelligence" features to the picture accumulating app. Over the weekend, a Reddit user discovered a few lines of code within the framework of Apple's beta of the macOS Sierra Photos app, possibly detailing both the specific facial expressions that the app recognizes and every single searchable object users can find in both Sierra and iOS 10.

In a more detailed Medium post, Redditor vista980622 explained that Photos will be able to "recognize and distinguish" 7 total facial expressions after the app scans a user's library and forms a "faceprint" for each individual in a picture. The expressions include greedy, disgust, neutral, scream, smiling, surprise, and suspicious.

macossierraphotosmemories
One of the biggest new additions to Photos in iOS 10 and Sierra is "Memories," a new tab that aggregates a user's pictures into logical, organized folders based on the app's new facial and object recognition abilities. vista980622 discovered every category of Memories as well, whose names are said to be "automatically generated using metadata from the photos and tags from analysis of photos."

The category names are as follows:

Memories from areas of interest, Best of past memories, Memories that break out of routine, Celebration in history, Contextual memories, Crowd, Day in history, Holiday in history, Location of interest, Nearby, New contextual memories, New memories, Person’s Birthdays, Person’s memories, Recent events (calendar, crowd, holiday, people, person, social, trip, weekend), Region of interest, Social group memories, Sometime memories, Special memories, Favourited, Trips, Week in history, Weekend, Year summary, Last week, Last Weekend

Users who have been testing the first beta of iOS 10 last week mentioned the impressive search parameters of Photos, which intelligently detects and tags every picture for the scenes, objects, and landmarks captured within. In totality, there are 432 of these items that can be searched for by the user, including everyday phrases like "Apartment" and "Birthday Cake," and somewhat obscure inquiries like "Diadem" and "Gastropod."

Additionally, you can search for various landmarks. For example, Photos can respond for search query of “Maho” (beach in Saint Martin), despite Photos is not programmed or trained to understand specific landmarks. Behind the scenes, Photos app first generates a generic categorization for the scene, “beach”, then searches through a built-in dictionary for all landmarks that has the name “beach” in its definition. Therefore, cleverly, despite Photos app knows nothing about “Maho” in particular, it is still able to return the right results. The same applies to nature scenes, water scenes and urban scenes.

The full list of 432 searchable objects and scenes can be found in the Medium post shared on Reddit. As discovered within the first beta of iOS 10 and macOS Sierra, the comprehensive list is far from confirmed as accurate. All the same, many of its terms do match up with another Redditor's successfully executed searches, as well as the words they claimed failed to generate any concrete results.

Previous Coverage: See iOS 10's New Photos App in Action

Update: The list of searchable scenes and objects appears to account for around 4,432 items, as opposed to the 432 mentioned in this article and the original Medium post. It's unclear whether vista980622 made a typo in the blog post, or if groups of scenes and items -- like Art, Artistic Creation, Artistic Creations, Artistries, Artistry, Arts, Artwork, Artworks -- were grouped together to result in a smaller number.

Update 2: The author of the Medium post has acknowledged that the originally quoted 432 scenes and objects was a typo and the correct number should indeed be 4,432.

Related Forums: iOS 10, macOS Sierra

Top Rated Comments

_mdavenport Avatar
80 months ago

The expressions include greedy, disgust, neutral, scream, smiling, surprise, and suspicious.
-Tim Cook: "Siri, show me pictures where I look greedy"

-Siri: "Ok, here is a picture of you giving the thumbs up on 16gb base iPhone storage and 5400 RPM hard drives"
Score: 26 Votes (Like | Disagree)
Porco Avatar
80 months ago
7 total facial expressions after the app scans a user's library and forms a "faceprint" for each individual in a picture. The expressions include greedy, disgust, neutral, scream, smiling, surprise, and suspicious.
It hasn't been confirmed yet, but they are believed to be distant cousins of Bashful, Doc, Dopey, Grumpy, Happy, Sleepy and Sneezy. Software engineers at Cupertino are also rumoured to be working on adding magic mirrors to the list of objects that the Photos App can detect so users can sort faces into a list by the 'fairest of them all' category, but have strongly denied there is any such thing as a 'poisoned apple' to recognise, despite some early reports images of such an item had involuntarily put some users' computers to sleep.
Score: 14 Votes (Like | Disagree)
SteveJobs2.0 Avatar
80 months ago
Most frequently identified expression? The duck face.
Score: 12 Votes (Like | Disagree)
thisisnotmyname Avatar
80 months ago
This is a disgusting invasion of my privacy, I can't even take a picture with out Google spying on me...oh wait it's Apple...never mind it's magical and a brilliant innovation.
Guess who didn't watch the keynote.

(it doesn't upload, this is done locally on device)
Score: 10 Votes (Like | Disagree)
FieldingMellish Avatar
80 months ago
Hopefully, Apple won't make the same mistake by Google that tagged African Americans as gorillas.
Score: 10 Votes (Like | Disagree)
Abazigal Avatar
80 months ago
Apple first introduced their 64-bit processor in 2013. I wonder if they had implemented this with these features in mind. That would have been really forward-thinking of them.
Score: 7 Votes (Like | Disagree)

Popular Stories

iPhone 14 Dummies 1 Feature

Everything Rumored for Apple's September Event: iPhone 14, Apple Watch Pro and More

Friday August 12, 2022 2:34 pm PDT by
There's just about a month to go until Apple holds its annual September event focusing on new iPhone and Apple Watch models. We thought we'd take a quick look at everything that's rumored for Apple's September event to give MacRumors readers a rundown on what to expect when the first fall event rolls around. iPhone 14 The iPhone 14 can probably be described more as an "iPhone 13S" because...
z fold 4 1

Hands-On With Samsung's Latest Foldable Smartphones, the Galaxy Z Fold and Z Flip

Friday August 12, 2022 12:46 pm PDT by
Samsung this week launched its fourth-generation foldable devices, the $1,000 Galaxy Z Flip and the $1,800 Galaxy Z Fold. Though there's no sign of a comparable Apple foldable device on the horizon, rumors suggest prototypes are in the works, so we thought we'd take a look at Samsung's newest smartphones to see what Apple needs to measure up to when a foldable iPhone does come out. Subscribe ...
iPhone 14 Pro Purple Rear Flat MacRumors Exclusive

iPhone 14 Pro: Analyst Believes Storage Will Continue to Start at 128GB Despite Rumored Price Increase

Friday August 12, 2022 7:04 am PDT by
It wouldn't be the month before an iPhone launch without a few back-and-forth rumors, with the latest debate concerning iPhone 14 Pro storage. iPhone 14 Pro render by Ian Zelbo While research firm TrendForce forecasted that iPhone 14 Pro models could start with an increased 256GB of storage, Haitong International analyst Jeff Pu today forecasted that the upcoming Pro models will continue to...
iPhone 14 Pro Purple Front and Back MacRumors Exclusive feature

iPhone 14 Is Just a Few Weeks Away: Three Tips to Prepare for the New iPhone

Wednesday August 10, 2022 4:08 am PDT by
The launch of the new iPhone 14 is just a few weeks away, meaning millions of iPhone customers will soon upgrade their existing iPhone or perhaps get an iPhone for the first time. Exclusive MacRumors iPhone 14 Pro renders by graphic designer Ian Zelbo Whether upgrading from an older model or this is your first iPhone, we've rounded up a few tips to help you prepare for the next flagship...
iPhone 14 Pro Lineup Feature Silver

Kuo: Apple to Increase Prices of iPhone 14 Pro Models

Wednesday August 10, 2022 8:22 am PDT by
Apple plans to increase the prices of iPhone 14 Pro models compared to iPhone 13 Pro models, according to analyst Ming-Chi Kuo. Kuo did not reveal exact pricing for the iPhone 14 Pro models. However, in a tweet today, he estimated that the average selling price of the iPhone 14 lineup as a whole will increase by about 15% compared to the iPhone 13 lineup. In the United States, the iPhone...
top stories 13aug2022

Top Stories: New Battery Percentage Icon in iOS 16, USB-C AirPods Rumor, and More

Saturday August 13, 2022 6:00 am PDT by
This week brought some shocking news for iOS 16 beta testers, with Apple bringing back the iPhone battery percentage to the status bar after a number of years. Other news and rumors this week included word that Apple has started recording portions of its media event planned for next month to introduce the iPhone 14 and Apple Watch Series 8, claims about iPhone 14 Pro pricing and Apple's...