New Photos App Detects 4,432 Total Searchable Objects and 7 Facial Expressions [Updated]

One of Apple's first party apps that's getting a makeover in iOS 10 and macOS Sierra is Photos, bringing intensive new facial recognition and "Siri intelligence" features to the picture accumulating app. Over the weekend, a Reddit user discovered a few lines of code within the framework of Apple's beta of the macOS Sierra Photos app, possibly detailing both the specific facial expressions that the app recognizes and every single searchable object users can find in both Sierra and iOS 10.

In a more detailed Medium post, Redditor vista980622 explained that Photos will be able to "recognize and distinguish" 7 total facial expressions after the app scans a user's library and forms a "faceprint" for each individual in a picture. The expressions include greedy, disgust, neutral, scream, smiling, surprise, and suspicious.

macossierraphotosmemories
One of the biggest new additions to Photos in iOS 10 and Sierra is "Memories," a new tab that aggregates a user's pictures into logical, organized folders based on the app's new facial and object recognition abilities. vista980622 discovered every category of Memories as well, whose names are said to be "automatically generated using metadata from the photos and tags from analysis of photos."

The category names are as follows:

Memories from areas of interest, Best of past memories, Memories that break out of routine, Celebration in history, Contextual memories, Crowd, Day in history, Holiday in history, Location of interest, Nearby, New contextual memories, New memories, Person’s Birthdays, Person’s memories, Recent events (calendar, crowd, holiday, people, person, social, trip, weekend), Region of interest, Social group memories, Sometime memories, Special memories, Favourited, Trips, Week in history, Weekend, Year summary, Last week, Last Weekend

Users who have been testing the first beta of iOS 10 last week mentioned the impressive search parameters of Photos, which intelligently detects and tags every picture for the scenes, objects, and landmarks captured within. In totality, there are 432 of these items that can be searched for by the user, including everyday phrases like "Apartment" and "Birthday Cake," and somewhat obscure inquiries like "Diadem" and "Gastropod."

Additionally, you can search for various landmarks. For example, Photos can respond for search query of “Maho” (beach in Saint Martin), despite Photos is not programmed or trained to understand specific landmarks. Behind the scenes, Photos app first generates a generic categorization for the scene, “beach”, then searches through a built-in dictionary for all landmarks that has the name “beach” in its definition. Therefore, cleverly, despite Photos app knows nothing about “Maho” in particular, it is still able to return the right results. The same applies to nature scenes, water scenes and urban scenes.

The full list of 432 searchable objects and scenes can be found in the Medium post shared on Reddit. As discovered within the first beta of iOS 10 and macOS Sierra, the comprehensive list is far from confirmed as accurate. All the same, many of its terms do match up with another Redditor's successfully executed searches, as well as the words they claimed failed to generate any concrete results.

Previous Coverage: See iOS 10's New Photos App in Action

Update: The list of searchable scenes and objects appears to account for around 4,432 items, as opposed to the 432 mentioned in this article and the original Medium post. It's unclear whether vista980622 made a typo in the blog post, or if groups of scenes and items -- like Art, Artistic Creation, Artistic Creations, Artistries, Artistry, Arts, Artwork, Artworks -- were grouped together to result in a smaller number.

Update 2: The author of the Medium post has acknowledged that the originally quoted 432 scenes and objects was a typo and the correct number should indeed be 4,432.

Top Rated Comments

(View all)
Avatar
57 months ago


The expressions include greedy, disgust, neutral, scream, smiling, surprise, and suspicious.

-Tim Cook: "Siri, show me pictures where I look greedy"

-Siri: "Ok, here is a picture of you giving the thumbs up on 16gb base iPhone storage and 5400 RPM hard drives"
Score: 26 Votes (Like | Disagree)
Avatar
57 months ago

7 total facial expressions after the app scans a user's library and forms a "faceprint" for each individual in a picture. The expressions include greedy, disgust, neutral, scream, smiling, surprise, and suspicious.

It hasn't been confirmed yet, but they are believed to be distant cousins of Bashful, Doc, Dopey, Grumpy, Happy, Sleepy and Sneezy. Software engineers at Cupertino are also rumoured to be working on adding magic mirrors to the list of objects that the Photos App can detect so users can sort faces into a list by the 'fairest of them all' category, but have strongly denied there is any such thing as a 'poisoned apple' to recognise, despite some early reports images of such an item had involuntarily put some users' computers to sleep.
Score: 14 Votes (Like | Disagree)
Avatar
57 months ago
Most frequently identified expression? The duck face.
Score: 12 Votes (Like | Disagree)
Avatar
57 months ago

This is a disgusting invasion of my privacy, I can't even take a picture with out Google spying on me...oh wait it's Apple...never mind it's magical and a brilliant innovation.

Guess who didn't watch the keynote.

(it doesn't upload, this is done locally on device)
Score: 10 Votes (Like | Disagree)
Avatar
57 months ago
Hopefully, Apple won't make the same mistake by Google that tagged African Americans as gorillas.
Score: 10 Votes (Like | Disagree)
Avatar
57 months ago
Apple first introduced their 64-bit processor in 2013. I wonder if they had implemented this with these features in mind. That would have been really forward-thinking of them.
Score: 7 Votes (Like | Disagree)

Top Stories

New Photos Offer Better Look at iPhone 12 Color Options

Tuesday October 20, 2020 2:34 am PDT by
As we wait for the iPhone 12 review embargo to lift later today, more pictures are circulating of the devices in real-world lighting conditions, providing a better look at the different colors available. Leaker DuanRui has shared images on Twitter of the iPhone 12 in white, black, blue, green, and (PRODUCT)RED. The black and white colors are similar to the iPhone 11 colors, but the other...

iPhone 12 Pro in Graphite and iPhone 12 in Blue Shown Off in Unboxing Videos

Monday October 19, 2020 8:20 am PDT by
While the iPhone 12 Pro does not launch until Friday, we now have an early unboxing video of the device courtesy of Twitter account DuanRui, providing a closer look at the shiny new flat-edge design and sleek Graphite color option. Ben Geskin re-uploaded the unboxing video to YouTube, which we've embedded below: Geskin has also uploaded an unboxing video of the iPhone 12 in Blue: ...

Apple Releases iPadOS and iOS 14.1 With Multiple Bug Fixes Ahead of iPhone 12 Launch

Tuesday October 20, 2020 10:06 am PDT by
Apple today released iOS and iPadOS 14.1, the first major updates to the iOS and iPadOS 14 operating system updates that were released in September. iOS and iPadOS 14.1 come a week after Apple released the golden master versions of the updates to developers. The iOS 14.1 update can be downloaded for free and it is available on all eligible devices over-the-air in the Settings app. To access...

Watch: iPhone 12 and iPhone 12 Pro Unboxing Videos and First Impressions

Tuesday October 20, 2020 6:05 am PDT by
Apple's embargo has lifted for iPhone 12 and iPhone 12 Pro reviews. In addition to our detailed review roundups for each device, we've rounded up over a dozen unboxing videos and first impressions below. iPhone 12 in Blue on left and iPhone 12 Pro in Pacific Blue on right via Engadget Key new features of the iPhone 12 and iPhone 12 Pro include a flat-edge design, 5G support, a much faster A14 ...

Gold Version of iPhone 12 Pro Apparently Has a More Fingerprint Resistant Stainless Steel Frame

Tuesday October 20, 2020 11:56 am PDT by
iPhone 12 Pro reviews hit the web today, and one of the more interesting tidbits came from TechCrunch's Matthew Panzarino, who revealed that the Gold version of the device apparently has a more fingerprint resistant coating applied to the stainless steel frame. From his review:Most of the iPhone 12 Pro finishes still use a physical vapor deposition process for edge coating. But the new gold...

Photographer Austin Mann Tests the iPhone 12 Pro's Camera

Wednesday October 21, 2020 4:14 am PDT by
Travel photographer Austin Mann usually performs an in-depth review of new iPhone models to test their camera performance in real-world scenarios. To test Apple's new iPhone 12 Pro, Mann traveled to Glacier National Park, Montana. Mann focused on some of the biggest camera upgrades with the iPhone 12 Pro, including the upgraded Wide lens, Ultra Wide Night mode, and LiDAR autofocus, across a...

iPhone 12 Pro Max Has Smaller 3,687 mAh Battery According to Regulatory Filing

Tuesday October 20, 2020 8:48 pm PDT by
Apple's new iPhone 12 Pro Max is equipped with a 3,687 mAh battery, which is around 7% less capacity than the 3,969 mAh battery in the iPhone 11 Pro Max, according to a regulatory filing published by TENAA, the Chinese equivalent of the FCC. The regulatory filing, spotted by MacRumors, also lists the iPhone 12 Pro Max with 6GB of RAM as seen in benchmark results last week. Apple has filed ...

5G Drains iPhone 12 Battery 20% Faster Than 4G in Benchmark

Wednesday October 21, 2020 3:17 am PDT by
After the first reviews for the iPhone 12 and iPhone 12 Pro emerged yesterday, a new report by Tom's Guide reveals the extent of battery life reductions when using 5G. The report outlines a test wherein the iPhone surfs the web continuously at 150 nits of screen brightness, launching a new site every 30 seconds until the battery drains. Interestingly, the test was run on an iPhone 12 and...

Hands-On With Apple's iPhone 12 and 12 Pro MagSafe Cases

Tuesday October 20, 2020 1:33 pm PDT by
Apple's iPhone 12 and 12 Pro are launching this Friday, and ahead of that release date, Apple is shipping out various accessories like the MagSafe charger and MagSafe cases. Yesterday we took a look at the MagSafe charger, and today our MagSafe case came in the mail, so we thought we'd take another look at the charger to see how it works with the case and just how strong the case magnets are. S ...

Reliable Leaker Suggests AirTags 'Coming Soon' in Two Different Sizes

Tuesday October 20, 2020 1:53 am PDT by
Apple's rumored AirTags Bluetooth tracking devices could launch imminently and will be available in two size options, based on new tweets from cryptic-but-reliable leaker L0vetodream. In typical enigmatic style, the leaker first tweeted this morning that a "big one" and a "small one" are "coming soon," but withheld what they were referring to. However that was followed an hour later with the ...