Apple today published a new entry in its online Machine Learning Journal, this time covering an on-device deep neural network for face detection, aka the technology that's used to power the facial recognition feature used in Photos and other apps.

Facial detection features were first introduced as part of iOS 10 in the Core Image framework, and it was used on-device to detect faces in photos so people could view their images by person in the Photos app.

apple machine learning journal
Implementing this technology was no small feat, says Apple, as it required "orders of magnitude more memory, much more disk storage, and more computational resources."

Apple's iCloud Photo Library is a cloud-based solution for photo and video storage. However, due to Apple's strong commitment to user privacy, we couldn't use iCloud servers for computer vision computations. Every photo and video sent to iCloud Photo Library is encrypted on the device before it is sent to cloud storage, and can only be decrypted by devices that are registered with the iCloud account. Therefore, to bring deep learning based computer vision solutions to our customers, we had to address directly the challenges of getting deep learning algorithms running on iPhone.

Apple's Machine Learning Journal entry describes how Apple overcame these challenges by leveraging GPU and CPU in iOS devices, developing memory optimizations for network interference, image loading, and caching, and implementing the network in a way that did not interfere with other tasks expected on iPhone.

The new entry is well worth reading if you're interested in the specific details behind how Apple overcame these challenges to successfully implemented the feature. The technical details are dense, but understandable, and it provides some interesting insight into how facial recognition works.

With its Machine Learning Journal, Apple aims to share the complex concepts behind its technology so the users of its products can get a look behind the curtain. It also serves as a way for Apple's engineers to participate in the AI community.

Apple has previously shared several articles on Siri, including how "Hey Siri," works, and a piece on using machine learning and neural networks for refining synthetic images.

Top Rated Comments

H3LL5P4WN Avatar
53 months ago
Do I enjoy paying over $1000 for a phone (as I have for what, 3 straight years now?)? No. Will I continue to do so? Until they make me a 512gb phone south of that mark, yes. Yes I will.

But bahgawd, the technology Apple is pulling off really is falling squarely into the realm of magical.
Score: 1 Votes (Like | Disagree)
Relentless Power Avatar
53 months ago
Anyone else just wowed by the amount of technology embedded into this new iPhone? Our phones are learning more about us then we ever knew Before.
Score: 1 Votes (Like | Disagree)
spacemnspiff Avatar
53 months ago
Anyone else just wowed by the amount of technology embedded into this new iPhone? Our phones are learning more about us then we ever knew Before.
Yet people keep complaining about price, because all it has is the same hardware as the iPhone 8, make childish comments by attributing extra cost to the OLED screen and claiming that no innovation in the smartphone industry is to be had. These high school minded kids have got to grow up.
Score: 1 Votes (Like | Disagree)
69Mustang Avatar
53 months ago
But bahgawd, the technology Apple is pulling off really is falling squarely into the realm of magical.
The entire AI community is working on some voodoo. If you couple it with advances in robotics... we are about 2 hours and 23 minutes away from the uprising. This mofo is untethered.
Score: 1 Votes (Like | Disagree)

Related Stories

iphone holiday

Best Black Friday iPhone Deals Still Available

Friday November 26, 2021 4:58 am PST by
Cellular carriers have always offered big savings on the newest iPhone models in holidays past, and Black Friday 2021 is no different. Right now we're tracking notable offers on the iPhone 13 and iPhone 13 Pro devices from AT&T, Verizon, and T-Mobile. For even more savings, keep an eye on older models like iPhone SE. Note: MacRumors is an affiliate partner with some of these vendors. When you...
airpods family holiday

Best Black Friday AirPods Deals Still Available

Friday November 26, 2021 4:04 am PST by
Black Friday 2021 deals are still going strong, and we're tracking the best deals across Apple's AirPods lineup. Throughout the week we've been sharing the best sales for Apple devices like iPhone, Mac, and iPad, so be sure to follow us on Twitter for all of the latest Black Friday sales Note: MacRumors is an affiliate partner with some of these vendors. When you click a link and make a...
apple mixed reality headset mockup feature purple

Kuo: Apple AR Headset Coming in Late 2022 With Mac-Level Computing Power

Thursday November 25, 2021 8:32 pm PST by
Apple's long-rumored augmented reality (AR) headset project is set to bear its first fruit late next year with the launch of the first device carrying a pair of processors to support its high-end capabilities, according to a new research report from noted analyst Ming-Chi Kuo seen by MacRumors. According to Kuo, the higher-end main processor is said to be similar to the M1 chip Apple...
apple watch cellular holiday

Best Black Friday Apple Watch Deals Still Available

Friday November 26, 2021 4:55 am PST by
The Apple Watch always makes a great gift around the holiday season, and for Black Friday 2021 we're tracking a few solid offers on numerous models of the Apple Watch. In this article, you'll find the best Black Friday sales on the new Apple Watch 7, but the best money-saving discounts will be found on older models like the Apple Watch Series 3 and SE. Note: MacRumors is an affiliate partner...
iPads black friday 20 sale feature

Best Black Friday iPad Deals Still Available

Friday November 26, 2021 4:48 am PST by
Although Black Friday sales began as early as October in 2021, the shopping holiday is now officially underway and we're highlighting the best sales for each of Apple's product lines. In this article, you'll find the best Black Friday sales on iPad Pro and iPad mini. Note: MacRumors is an affiliate partner with some of these vendors. When you click a link and make a purchase, we may receive a...
mac family holiday

Best Black Friday iMac and MacBook Deals Still Available

Friday November 26, 2021 4:29 am PST by
Our Black Friday 2021 coverage continues with the best deals you can find on MacBook Pro, MacBook Air, iMac, and Mac mini today. As with all Black Friday deals, we aren't sure how long any of these will last, and prices are always fluctuating, so if you see something you want, be sure to buy it soon. Note: MacRumors is an affiliate partner with some of these vendors. When you click a link and...
General black friday 20 sale feature

Huge List of Black Friday Deals on iPhone and Mac Cases, Cables, Accessories and Software

Friday November 26, 2021 5:09 am PST by
Black Friday is in full swing today, and in this article we're highlighting some of the best deals that you can find online among popular third-party accessory makers like Twelve South, Nomad, Satechi, and many more. Visit our Black Friday Roundup for a deeper dive into the best sales going on today. Note: MacRumors is an affiliate partner with some of these vendors. When you click a link and...
apple black friday shopping event 2021

Apple's Black Friday Promotion Now Underway in the U.S. and More Countries

Friday November 26, 2021 12:07 am PST by
Apple's annual four-day Black Friday through Cyber Monday shopping event is now underway in the United States and select other countries, with customers able to receive a free Apple gift card with the purchase of select products through November 29. Participating countries include the United States, Canada, Australia, New Zealand, the UK, Ireland, France, Spain, Portugal, Italy, Germany,...