Apple was awarded a patent today that details a method of detecting faces in a digital video feed through the use of depth information.

Published by the U.S. Patent and Trademark Office, the document describes how face detection algorithms could identify the presence of faces in a live video when people in the scene are located at different distances from the camera.

Screen Shot 4 e1488886008905
To reduce processing overhead and minimize error rates, the system applies depth information to existing face detection algorithms used in photography and intelligently scales the face window sizes according to their depth coordinates – i.e., the further away a face is from the lens, the smaller the capture frame around it.

The method utilizes a special infrared light to project an optical radiation pattern onto the scene, which is then converted into a depth map. As noted by AppleInsider, the depth mapping system referenced in the patent is based on motion tracking technology developed by Israeli motion capture firm PrimeSense, which Apple acquired in 2013.

Screen Shot 3 1
While the system is able to recognize faces in general, it lacks the ability to identify individual differences between faces, so this isn't a bio-recognition solution in itself, but it could become a crucial enabling step in a wider authentication system.

Apple is said to be developing a "revolutionary" front-facing camera system for the upcoming "iPhone 8". The technology is rumored to consist of three modules to enable fully-featured 3D sensing capabilities. While there's no way to know for sure if this particular patent describes one of those modules, the upgraded camera system is said to be fueled by PrimeSense algorithms.

Tag: Patent
Related Forum: iPhone

Top Rated Comments

newyorksole Avatar
88 months ago
Selling my stock just befor iPhone 8, not because it will be poor, in fact I expect it to be excellent... still, it won't have the usb-c, full glass, oled with intergrated fingerprint scanner, with revolutionary front camera, full wireless charging, multi day battamerylife, quick charge, liquid metal and touch bar. These high expectations are going to make a great phone seem ordinary and people need to understand that.
I think you may be underestimating how big of a release this will be.

iPhone is Apple's cash cow. This is the 10 year anniversary and also will probably be the first event at Steve Jobs Theater.

It may not have all of THOSE features you listed, but whatever they release is going to be damn good. They wouldn't waste this release with mediocre features.
Score: 4 Votes (Like | Disagree)
69Mustang Avatar
88 months ago
As @djcerla stipulated in one thread, unlocking with face recognition would likely be a backup/secondary solution for Touch ID. So you can use either or. :)
Every phone that's offering facial/retina/iris unlock is offering it as an option. There's no reason for anyone to think Apple would offer it as the only solution. People work themselves into a lather over nothing.
Score: 4 Votes (Like | Disagree)
keysofanxiety Avatar
88 months ago
So I can't unlock the phone down low if I need to be discreet about messaging someone or checking something?
As @djcerla stipulated in one thread, unlocking with face recognition would likely be a backup/secondary solution for Touch ID. So you can use either or. :)
Score: 3 Votes (Like | Disagree)
benadd Avatar
88 months ago
PrimeSense was an Israeli company, not Italian.

('https://www.macrumors.com/2017/03/07/apple-face-detection-patent-iphone-8/')


Apple was awarded a patent today that details a method of detecting faces in a digital video feed through the use of depth information.

Published by the U.S. Patent and Trademark Office, the document ('http://patft.uspto.gov/netacgi/nph-Parser?Sect1=PTO2&Sect2=HITOFF&u=%2Fnetahtml%2FPTO%2Fsearch-adv.htm&r=2593&f=G&l=50&d=PTXT&s1=(1%2F1.CCLS.+AND+20170307.PD.)&p=52&OS=ccl/1/1+and+isd/3/7/2017&RS=(CCL/1/1+AND+ISD/20170307)') describes how face detection algorithms could identify the presence of faces in a live video when people in the scene are located at different distances from the camera.



To reduce processing overhead and minimize error rates, the system applies depth information to existing face detection algorithms used in photography and intelligently scales the face window sizes according to their depth coordinates - i.e., the further away a face is from the lens, the smaller the capture frame around it.

The method utilizes a special infrared light to project an optical radiation pattern onto the scene, which is then converted into a depth map. As noted by AppleInsider ('http://appleinsider.com/articles/17/03/07/apple-patents-method-of-detecting-faces-using-depth-information-bolsters-iphone-8-rumors'), the depth mapping system referenced in the patent is based on motion tracking technology developed by Italian motion capture firm PrimeSense, which Apple acquired in 2013 ('https://www.macrumors.com/2013/11/24/apple-confirms-acquisition-of-israeli-3d-body-sensing-firm-primesense/').



While the system is able to recognize faces in general, it lacks the ability to identify differences between individual faces, so this isn't a bio-recognition solution in itself, but it could become a crucial enabling step in a wider authentication system.

Apple is said to be developing a "revolutionary" front-facing camera system ('https://www.macrumors.com/2017/02/21/upcoming-oled-iphone-camera/') for the upcoming "iPhone 8". The technology is rumored to consist of three modules to enable fully-featured 3D sensing capabilities. While there's no way to know for sure if this particular patent describes one of those modules, the upgraded camera system is said to be fueled by PrimeSense algorithms.

Article Link: Apple Face Detection Patent Hints at Possible PrimeSense Tech Headed For 'iPhone 8' ('https://www.macrumors.com/2017/03/07/apple-face-detection-patent-iphone-8/')
Score: 2 Votes (Like | Disagree)
thisisnotmyname Avatar
88 months ago
As @djcerla stipulated in one thread, unlocking with face recognition would likely be a backup/secondary solution for Touch ID. So you can use either or. :)
I really do hope they make facial recognition as an authentication mechanism optional via configuration. I don't want someone being able to unlock my phone by forcing it in front of my face.
Score: 1 Votes (Like | Disagree)
69Mustang Avatar
88 months ago
That picture just looks (descriptively sounds) like the version 1 of the Kinect.
Score: 1 Votes (Like | Disagree)

Popular Stories

iOS 16 4 Web Push

Apple Confirms Governments Using Push Notifications to Surveil Users

Wednesday December 6, 2023 5:06 am PST by
Unidentified governments are surveilling smartphone users by tracking push notifications that move through Google's and Apple's servers, a US senator warned on Wednesday (via Reuters). In a letter to the Department of Justice, Senator Ron Wyden said foreign officials were demanding the data from the tech giants to track smartphones. The traffic flowing from apps that send push notifications...
best buy snowflakes

Best Buy's New Weekend Sale Has Record Low Prices on MacBook Pro and MacBook Air

Friday December 8, 2023 7:37 am PST by
Best Buy's month-long holiday sale continues this weekend with multiple all-time low prices on Apple's line of MacBook Pro and MacBook Air computers. In addition to Apple notebooks, Best Buy's event has discounts sitewide on home appliances, TVs, video games, and more. Note: MacRumors is an affiliate partner with some of these vendors. When you click a link and make a purchase, we may receive...
iOS 17

iOS 17.2 Will Add These 12 New Features to Your iPhone

Friday December 1, 2023 12:19 pm PST by
iOS 17.2 has been in beta testing for over a month, and it should be released to all users in a few more weeks. The software update includes many new features and changes for iPhones, including the dozen that we have highlighted below. iOS 17.2 is expected to be released to the public in mid-December. To learn about even more features coming in the update, check out our full list. Journal ...
beeper mini

Apple Puts a Stop to Beeper Mini's iMessage for Android Feature

Friday December 8, 2023 2:24 pm PST by
Apple appears to have closed the loophole that Beeper Mini used to bring iMessage to Android, putting a stop to blue bubbles from Android devices. Beeper Mini quit working earlier today, with users receiving "failed to lookup on server: lookup request timed out" error messages. Beeper said on Twitter that it is investigating the issue, but Beeper CEO Eric Migicovsky told TechCrunch that "all ...
apple watch black friday

Apple Watch Ultra 2 Hits New Record Low Price of $699, Alongside Series 9 and SE Sales

Friday December 8, 2023 8:55 am PST by
Amazon has a few big discounts on Apple Watch today, headlined by a new all-time low price on the Apple Watch Ultra 2. Many of these watches can be delivered by Christmas, with delivery dates around the middle of next week for most models. Note: MacRumors is an affiliate partner with Amazon. When you click a link and make a purchase, we may receive a small payment, which helps us keep the site ...
maxresdefault

Review: Two Months With the iPhone 15 Pro Max

Thursday December 7, 2023 12:04 pm PST by
Apple's iPhone 15 lineup came out in September, and while most reviews are done shortly after a new device launches, we like to follow up with a longer term review that gives us an opportunity to provide a deeper dive into what it's like using these phones on a day to day basis for months. Subscribe to the MacRumors YouTube channel for more videos. MacRumors videographer Dan Barbera has been...
iphone se 4 modified flag edges

iPhone SE 4 May Reuse Existing iPhone 14 Battery

Wednesday December 6, 2023 1:17 pm PST by
Recently, MacRumors has received details on the battery currently being tested on the upcoming fourth-generation iPhone SE, and the information corroborates previous findings in relation to the device. The iPhone SE 4, known by its device identifier D59, is expected to use the exact same battery found in the base model iPhone 14. Partially assembled prototypes of the next iPhone SE have been ...
iOS 17

35 Things Your iPhone Can Do in iOS 17.2 Coming Next Week

Wednesday December 6, 2023 5:57 am PST by
Apple made the first beta of iOS 17.2 available to developers in October. Since then we've seen three more betas, and with each iteration Apple continues to add more new features and changes, many of which users have been anticipating for quite a while. Below, we've listed 35 new things that are coming to your iPhone when the finalized version is publicly released in mid-December. 1....