Apple was awarded a patent today that details a method of detecting faces in a digital video feed through the use of depth information.

Published by the U.S. Patent and Trademark Office, the document describes how face detection algorithms could identify the presence of faces in a live video when people in the scene are located at different distances from the camera.

Screen Shot 4 e1488886008905
To reduce processing overhead and minimize error rates, the system applies depth information to existing face detection algorithms used in photography and intelligently scales the face window sizes according to their depth coordinates – i.e., the further away a face is from the lens, the smaller the capture frame around it.

The method utilizes a special infrared light to project an optical radiation pattern onto the scene, which is then converted into a depth map. As noted by AppleInsider, the depth mapping system referenced in the patent is based on motion tracking technology developed by Israeli motion capture firm PrimeSense, which Apple acquired in 2013.

Screen Shot 3 1
While the system is able to recognize faces in general, it lacks the ability to identify individual differences between faces, so this isn't a bio-recognition solution in itself, but it could become a crucial enabling step in a wider authentication system.

Apple is said to be developing a "revolutionary" front-facing camera system for the upcoming "iPhone 8". The technology is rumored to consist of three modules to enable fully-featured 3D sensing capabilities. While there's no way to know for sure if this particular patent describes one of those modules, the upgraded camera system is said to be fueled by PrimeSense algorithms.

Tag: Patent
Related Forum: iPhone

Top Rated Comments

newyorksole Avatar
68 months ago
Selling my stock just befor iPhone 8, not because it will be poor, in fact I expect it to be excellent... still, it won't have the usb-c, full glass, oled with intergrated fingerprint scanner, with revolutionary front camera, full wireless charging, multi day battamerylife, quick charge, liquid metal and touch bar. These high expectations are going to make a great phone seem ordinary and people need to understand that.
I think you may be underestimating how big of a release this will be.

iPhone is Apple's cash cow. This is the 10 year anniversary and also will probably be the first event at Steve Jobs Theater.

It may not have all of THOSE features you listed, but whatever they release is going to be damn good. They wouldn't waste this release with mediocre features.
Score: 4 Votes (Like | Disagree)
69Mustang Avatar
68 months ago
As @djcerla stipulated in one thread, unlocking with face recognition would likely be a backup/secondary solution for Touch ID. So you can use either or. :)
Every phone that's offering facial/retina/iris unlock is offering it as an option. There's no reason for anyone to think Apple would offer it as the only solution. People work themselves into a lather over nothing.
Score: 4 Votes (Like | Disagree)
keysofanxiety Avatar
68 months ago
So I can't unlock the phone down low if I need to be discreet about messaging someone or checking something?
As @djcerla stipulated in one thread, unlocking with face recognition would likely be a backup/secondary solution for Touch ID. So you can use either or. :)
Score: 3 Votes (Like | Disagree)
benadd Avatar
68 months ago
PrimeSense was an Israeli company, not Italian.

('https://www.macrumors.com/2017/03/07/apple-face-detection-patent-iphone-8/')


Apple was awarded a patent today that details a method of detecting faces in a digital video feed through the use of depth information.

Published by the U.S. Patent and Trademark Office, the document ('http://patft.uspto.gov/netacgi/nph-Parser?Sect1=PTO2&Sect2=HITOFF&u=%2Fnetahtml%2FPTO%2Fsearch-adv.htm&r=2593&f=G&l=50&d=PTXT&s1=(1%2F1.CCLS.+AND+20170307.PD.)&p=52&OS=ccl/1/1+and+isd/3/7/2017&RS=(CCL/1/1+AND+ISD/20170307)') describes how face detection algorithms could identify the presence of faces in a live video when people in the scene are located at different distances from the camera.



To reduce processing overhead and minimize error rates, the system applies depth information to existing face detection algorithms used in photography and intelligently scales the face window sizes according to their depth coordinates - i.e., the further away a face is from the lens, the smaller the capture frame around it.

The method utilizes a special infrared light to project an optical radiation pattern onto the scene, which is then converted into a depth map. As noted by AppleInsider ('http://appleinsider.com/articles/17/03/07/apple-patents-method-of-detecting-faces-using-depth-information-bolsters-iphone-8-rumors'), the depth mapping system referenced in the patent is based on motion tracking technology developed by Italian motion capture firm PrimeSense, which Apple acquired in 2013 ('https://www.macrumors.com/2013/11/24/apple-confirms-acquisition-of-israeli-3d-body-sensing-firm-primesense/').



While the system is able to recognize faces in general, it lacks the ability to identify differences between individual faces, so this isn't a bio-recognition solution in itself, but it could become a crucial enabling step in a wider authentication system.

Apple is said to be developing a "revolutionary" front-facing camera system ('https://www.macrumors.com/2017/02/21/upcoming-oled-iphone-camera/') for the upcoming "iPhone 8". The technology is rumored to consist of three modules to enable fully-featured 3D sensing capabilities. While there's no way to know for sure if this particular patent describes one of those modules, the upgraded camera system is said to be fueled by PrimeSense algorithms.

Article Link: Apple Face Detection Patent Hints at Possible PrimeSense Tech Headed For 'iPhone 8' ('https://www.macrumors.com/2017/03/07/apple-face-detection-patent-iphone-8/')
Score: 2 Votes (Like | Disagree)
thisisnotmyname Avatar
68 months ago
As @djcerla stipulated in one thread, unlocking with face recognition would likely be a backup/secondary solution for Touch ID. So you can use either or. :)
I really do hope they make facial recognition as an authentication mechanism optional via configuration. I don't want someone being able to unlock my phone by forcing it in front of my face.
Score: 1 Votes (Like | Disagree)
69Mustang Avatar
68 months ago
That picture just looks (descriptively sounds) like the version 1 of the Kinect.
Score: 1 Votes (Like | Disagree)

Popular Stories

iOS 16 mock for article

Gurman: iOS 16 to Include New Ways of System Interaction and 'Fresh Apple Apps'

Sunday May 15, 2022 6:14 am PDT by
iOS 16 will include new ways of interacting with the system and some "fresh Apple apps," Bloomberg's Mark Gurman has said, offering some more detail on what Apple has in store for the upcoming release of iOS and iPadOS set to be announced in a few weeks at WWDC. In the latest edition of his Power On newsletter, Gurman wrote that while iOS 16 is not likely to introduce a major face-lift to...
maxresdefault

Unbox Therapy Shares Hands-On Look at iPhone 14 Pro Max Replica

Monday May 16, 2022 4:40 am PDT by
YouTuber Unbox Therapy has shared a hands-on look at the iPhone 14 Pro Max using what he claims is a one-to-one replica created by third-party case makers with access to detailed schematics and dimensions for Apple's new upcoming flagship smartphone. As with the iPhone 13 Pro lineup, in 2022, we are expecting a 6.1-inch iPhone 14 Pro and a 6.7-inch iPhone 14 Pro Max, but this time the Pro...
RIP iPod Feature

RIP iPod: A Look Back at Apple's Iconic Music Player Over the Years

Friday May 13, 2022 2:25 pm PDT by
Apple earlier this week announced the discontinuation of the iPod touch, and because it was the last iPod still available for purchase, its sunsetting effectively marks the end of the entire iPod lineup. To send the iPod on its way, we thought it would be fun to take a look back at some of the most notable iPod releases over the last 21 years. Original iPod (2001) Introduced in October...
macOS Monterey 2

Apple Releases macOS Monterey 12.4 With Support for Studio Display Webcam Update

Monday May 16, 2022 10:10 am PDT by
Apple today released macOS Monterey 12.4, the fourth major update to the macOS Monterey operating system that launched in October 2021. macOS Monterey 12.4 comes over two months after the launch of macOS Monterey 12.3, an update that added Universal Control. The ‌‌‌‌‌macOS Monterey‌‌ 12.4 update can be downloaded on all eligible Macs using the Software Update section of System...
iOS 15

Apple Releases iOS 15.5 and iPadOS 15.5 With Wallet and Podcast Updates

Monday May 16, 2022 10:00 am PDT by
Apple today released iOS 15.5 and iPadOS 15.5, the fifth major updates to the iOS and iPadOS 15 operating systems that were initially released in September 2021. iOS and iPadOS 15.5 come a little over two months after the launch of iOS 15.4 and iPadOS 15.4. The iOS 15.5 and iPadOS 15.5 updates can be downloaded for free and the software is available on all eligible devices over-the-air in...
airpodsprodesign

Kuo: AirPods, MagSafe Battery Pack, and Other Apple Accessories Also to Switch to USB-C in Future

Sunday May 15, 2022 5:59 am PDT by
Earlier this week, well-known Apple analyst Ming-Chi Kuo claimed that Apple plans to release at least one iPhone 15 model with a USB-C port in 2023. Now, in a follow-up tweet, he has claimed that accessories like AirPods, the MagSafe Battery Pack, and the Magic Keyboard/Mouse/Trackpad trio would also switch to USB-C in the "foreseeable future." Both the iPhone and all of the aforementioned...
apple tv 4k design green

Apple Releases tvOS 15.5 for Apple TV HD and Apple TV 4K

Monday May 16, 2022 9:57 am PDT by
Apple today released tvOS 15.5, the fifth major update to the tvOS operating system that first launched in September 2021. tvOS 15.5 comes more than two months after the release of tvOS 15.4, an update that brought support for captive WiFi networks. tvOS 15.5 can be downloaded over the air on the Apple TV through the Settings app by going to System > Software Update. ‌‌‌‌‌‌Apple...