Apple was awarded a patent today that details a method of detecting faces in a digital video feed through the use of depth information.

Published by the U.S. Patent and Trademark Office, the document describes how face detection algorithms could identify the presence of faces in a live video when people in the scene are located at different distances from the camera.

Screen Shot 4 e1488886008905
To reduce processing overhead and minimize error rates, the system applies depth information to existing face detection algorithms used in photography and intelligently scales the face window sizes according to their depth coordinates – i.e., the further away a face is from the lens, the smaller the capture frame around it.

The method utilizes a special infrared light to project an optical radiation pattern onto the scene, which is then converted into a depth map. As noted by AppleInsider, the depth mapping system referenced in the patent is based on motion tracking technology developed by Israeli motion capture firm PrimeSense, which Apple acquired in 2013.

Screen Shot 3 1
While the system is able to recognize faces in general, it lacks the ability to identify individual differences between faces, so this isn't a bio-recognition solution in itself, but it could become a crucial enabling step in a wider authentication system.

Apple is said to be developing a "revolutionary" front-facing camera system for the upcoming "iPhone 8". The technology is rumored to consist of three modules to enable fully-featured 3D sensing capabilities. While there's no way to know for sure if this particular patent describes one of those modules, the upgraded camera system is said to be fueled by PrimeSense algorithms.

Tag: Patent
Related Forum: iPhone

Top Rated Comments

newyorksole Avatar
111 months ago
Selling my stock just befor iPhone 8, not because it will be poor, in fact I expect it to be excellent... still, it won't have the usb-c, full glass, oled with intergrated fingerprint scanner, with revolutionary front camera, full wireless charging, multi day battamerylife, quick charge, liquid metal and touch bar. These high expectations are going to make a great phone seem ordinary and people need to understand that.
I think you may be underestimating how big of a release this will be.

iPhone is Apple's cash cow. This is the 10 year anniversary and also will probably be the first event at Steve Jobs Theater.

It may not have all of THOSE features you listed, but whatever they release is going to be damn good. They wouldn't waste this release with mediocre features.
Score: 4 Votes (Like | Disagree)
69Mustang Avatar
111 months ago
As @djcerla stipulated in one thread, unlocking with face recognition would likely be a backup/secondary solution for Touch ID. So you can use either or. :)
Every phone that's offering facial/retina/iris unlock is offering it as an option. There's no reason for anyone to think Apple would offer it as the only solution. People work themselves into a lather over nothing.
Score: 4 Votes (Like | Disagree)
keysofanxiety Avatar
111 months ago
So I can't unlock the phone down low if I need to be discreet about messaging someone or checking something?
As @djcerla stipulated in one thread, unlocking with face recognition would likely be a backup/secondary solution for Touch ID. So you can use either or. :)
Score: 3 Votes (Like | Disagree)
benadd Avatar
111 months ago
PrimeSense was an Israeli company, not Italian.

('https://www.macrumors.com/2017/03/07/apple-face-detection-patent-iphone-8/')


Apple was awarded a patent today that details a method of detecting faces in a digital video feed through the use of depth information.

Published by the U.S. Patent and Trademark Office, the document ('http://patft.uspto.gov/netacgi/nph-Parser?Sect1=PTO2&Sect2=HITOFF&u=%2Fnetahtml%2FPTO%2Fsearch-adv.htm&r=2593&f=G&l=50&d=PTXT&s1=(1%2F1.CCLS.+AND+20170307.PD.)&p=52&OS=ccl/1/1+and+isd/3/7/2017&RS=(CCL/1/1+AND+ISD/20170307)') describes how face detection algorithms could identify the presence of faces in a live video when people in the scene are located at different distances from the camera.



To reduce processing overhead and minimize error rates, the system applies depth information to existing face detection algorithms used in photography and intelligently scales the face window sizes according to their depth coordinates - i.e., the further away a face is from the lens, the smaller the capture frame around it.

The method utilizes a special infrared light to project an optical radiation pattern onto the scene, which is then converted into a depth map. As noted by AppleInsider ('http://appleinsider.com/articles/17/03/07/apple-patents-method-of-detecting-faces-using-depth-information-bolsters-iphone-8-rumors'), the depth mapping system referenced in the patent is based on motion tracking technology developed by Italian motion capture firm PrimeSense, which Apple acquired in 2013 ('https://www.macrumors.com/2013/11/24/apple-confirms-acquisition-of-israeli-3d-body-sensing-firm-primesense/').



While the system is able to recognize faces in general, it lacks the ability to identify differences between individual faces, so this isn't a bio-recognition solution in itself, but it could become a crucial enabling step in a wider authentication system.

Apple is said to be developing a "revolutionary" front-facing camera system ('https://www.macrumors.com/2017/02/21/upcoming-oled-iphone-camera/') for the upcoming "iPhone 8". The technology is rumored to consist of three modules to enable fully-featured 3D sensing capabilities. While there's no way to know for sure if this particular patent describes one of those modules, the upgraded camera system is said to be fueled by PrimeSense algorithms.

Article Link: Apple Face Detection Patent Hints at Possible PrimeSense Tech Headed For 'iPhone 8' ('https://www.macrumors.com/2017/03/07/apple-face-detection-patent-iphone-8/')
Score: 2 Votes (Like | Disagree)
thisisnotmyname Avatar
111 months ago
As @djcerla stipulated in one thread, unlocking with face recognition would likely be a backup/secondary solution for Touch ID. So you can use either or. :)
I really do hope they make facial recognition as an authentication mechanism optional via configuration. I don't want someone being able to unlock my phone by forcing it in front of my face.
Score: 1 Votes (Like | Disagree)
69Mustang Avatar
111 months ago
That picture just looks (descriptively sounds) like the version 1 of the Kinect.
Score: 1 Votes (Like | Disagree)

Popular Stories

iPhone 17 Pro Dark Blue and Orange

iPhone 17 Release Date, Pre-Orders, and What to Expect

Thursday August 28, 2025 4:08 am PDT by
An iPhone 17 announcement is a dead cert for September 2025 – Apple has already sent out invites for an "Awe dropping" event on Tuesday, September 9 at the Apple Park campus in Cupertino, California. The timing follows Apple's trend of introducing new iPhone models annually in the fall. At the event, Apple is expected to unveil its new-generation iPhone 17, an all-new ultra-thin iPhone 17...
Alleged iPhone 17 Pro Antenna Design

Two All-New iPhone 17 Colors Seemingly Confirmed

Monday August 25, 2025 4:22 am PDT by
Apple will offer the upcoming iPhone 17 Pro and iPhone 17 Pro Max in a new orange color, according to Bloomberg's Mark Gurman. Gurman made the claim in the latest edition of his Power On newsletter, adding that the new iPhone 17 Air – replacing the iPhone 16 Plus – will come in a new light blue color. We've heard multiple rumors about a new iPhone 17 Pro color being a shade of orange. The ...
Awe Dropping Apple Event Feature

Five Things to Expect From Apple's 'Awe Dropping' September 9 Event

Tuesday August 26, 2025 4:17 pm PDT by
Apple today announced its "Awe Dropping" iPhone-centric event, which is set to take place on Tuesday, September 9 at 10:00 a.m. Pacific Time. There are a long list of products that are coming, but we thought we'd pull out five feature highlights to look forward to. That Super Thin iPhone - Apple's September 9 event will see the unveiling of the first redesigned iPhone we've had in years, ...
awe dropping event

Apple Event Announced for September 9: 'Awe Dropping'

Tuesday August 26, 2025 9:01 am PDT by
Apple will hold its annual iPhone-centric event on Tuesday, September 9 at the Apple Park campus in Cupertino, California, according to an announcement that went out today. The event will start at 10:00 a.m., with select members of the media invited to attend. At the September 2025 iPhone event, Apple will unveil the iPhone 17 lineup, which includes an all-new ultra-thin iPhone 17 Air. It...
Awe Dropping Apple Event Feature

Apple Event Logo Hints at Two iPhone 17 Pro Features

Wednesday August 27, 2025 6:36 am PDT by
Apple's logo for its upcoming September 9 event hints at two rumored iPhone 17 Pro features, including new color options and a vapor chamber cooling system. Of course, this is all just speculation for fun, as we count down the final days until the event. New Colors Last month, Macworld's Filipe Espósito reported that orange and dark blue would be two out of the five color options...
airpods pro 2 gradient

AirPods Pro 3: Four Key Design Changes Anticipated

Tuesday August 26, 2025 4:05 am PDT by
Apple hasn't updated the AirPods Pro since 2022 other than a shift from Lightning to USB-C, and the earbuds are due for a refresh. According to Bloomberg's Mark Gurman, Apple will launch AirPods Pro 3 later this year, and apart from new features like heart rate monitoring, we're also expecting a few design changes. The fourth‑generation AirPods offer useful clues to Apple's design cues for ...
iPhone 17 Pro on Desk Centered 1

iPhone 17 Pro Coming Soon With These 12 New Features

Sunday August 24, 2025 6:00 am PDT by
Apple's iPhone 17 Pro and iPhone 17 Pro Max should be unveiled in a few more weeks, and there are plenty of rumors about the devices. In his Power On newsletter today, Bloomberg's Mark Gurman corroborated a rumor that iPhone 17 Pro models will be "available in an orange color." Below, we recap key changes rumored for the iPhone 17 Pro models: Aluminum frame: iPhone 17 Pro models are...