Apple was awarded a patent today that details a method of detecting faces in a digital video feed through the use of depth information.

Published by the U.S. Patent and Trademark Office, the document describes how face detection algorithms could identify the presence of faces in a live video when people in the scene are located at different distances from the camera.

Screen Shot 4 e1488886008905
To reduce processing overhead and minimize error rates, the system applies depth information to existing face detection algorithms used in photography and intelligently scales the face window sizes according to their depth coordinates – i.e., the further away a face is from the lens, the smaller the capture frame around it.

The method utilizes a special infrared light to project an optical radiation pattern onto the scene, which is then converted into a depth map. As noted by AppleInsider, the depth mapping system referenced in the patent is based on motion tracking technology developed by Israeli motion capture firm PrimeSense, which Apple acquired in 2013.

Screen Shot 3 1
While the system is able to recognize faces in general, it lacks the ability to identify individual differences between faces, so this isn't a bio-recognition solution in itself, but it could become a crucial enabling step in a wider authentication system.

Apple is said to be developing a "revolutionary" front-facing camera system for the upcoming "iPhone 8". The technology is rumored to consist of three modules to enable fully-featured 3D sensing capabilities. While there's no way to know for sure if this particular patent describes one of those modules, the upgraded camera system is said to be fueled by PrimeSense algorithms.

Tag: patent
Related Forum: iPhone

Top Rated Comments

newyorksole Avatar
57 months ago
Selling my stock just befor iPhone 8, not because it will be poor, in fact I expect it to be excellent... still, it won't have the usb-c, full glass, oled with intergrated fingerprint scanner, with revolutionary front camera, full wireless charging, multi day battamerylife, quick charge, liquid metal and touch bar. These high expectations are going to make a great phone seem ordinary and people need to understand that.
I think you may be underestimating how big of a release this will be.

iPhone is Apple's cash cow. This is the 10 year anniversary and also will probably be the first event at Steve Jobs Theater.

It may not have all of THOSE features you listed, but whatever they release is going to be damn good. They wouldn't waste this release with mediocre features.
Score: 4 Votes (Like | Disagree)
69Mustang Avatar
57 months ago
As [USER=957351]@djcerla[/USER] stipulated in one thread, unlocking with face recognition would likely be a backup/secondary solution for Touch ID. So you can use either or. :)
Every phone that's offering facial/retina/iris unlock is offering it as an option. There's no reason for anyone to think Apple would offer it as the only solution. People work themselves into a lather over nothing.
Score: 4 Votes (Like | Disagree)
keysofanxiety Avatar
57 months ago
So I can't unlock the phone down low if I need to be discreet about messaging someone or checking something?
As [USER=957351]@djcerla[/USER] stipulated in one thread, unlocking with face recognition would likely be a backup/secondary solution for Touch ID. So you can use either or. :)
Score: 3 Votes (Like | Disagree)
benadd Avatar
57 months ago
PrimeSense was an Israeli company, not Italian.

('https://www.macrumors.com/2017/03/07/apple-face-detection-patent-iphone-8/')


Apple was awarded a patent today that details a method of detecting faces in a digital video feed through the use of depth information.

Published by the U.S. Patent and Trademark Office, the document ('http://patft.uspto.gov/netacgi/nph-Parser?Sect1=PTO2&Sect2=HITOFF&u=%2Fnetahtml%2FPTO%2Fsearch-adv.htm&r=2593&f=G&l=50&d=PTXT&s1=(1%2F1.CCLS.+AND+20170307.PD.)&p=52&OS=ccl/1/1+and+isd/3/7/2017&RS=(CCL/1/1+AND+ISD/20170307)') describes how face detection algorithms could identify the presence of faces in a live video when people in the scene are located at different distances from the camera.



To reduce processing overhead and minimize error rates, the system applies depth information to existing face detection algorithms used in photography and intelligently scales the face window sizes according to their depth coordinates - i.e., the further away a face is from the lens, the smaller the capture frame around it.

The method utilizes a special infrared light to project an optical radiation pattern onto the scene, which is then converted into a depth map. As noted by AppleInsider ('http://appleinsider.com/articles/17/03/07/apple-patents-method-of-detecting-faces-using-depth-information-bolsters-iphone-8-rumors'), the depth mapping system referenced in the patent is based on motion tracking technology developed by Italian motion capture firm PrimeSense, which Apple acquired in 2013 ('https://www.macrumors.com/2013/11/24/apple-confirms-acquisition-of-israeli-3d-body-sensing-firm-primesense/').



While the system is able to recognize faces in general, it lacks the ability to identify differences between individual faces, so this isn't a bio-recognition solution in itself, but it could become a crucial enabling step in a wider authentication system.

Apple is said to be developing a "revolutionary" front-facing camera system ('https://www.macrumors.com/2017/02/21/upcoming-oled-iphone-camera/') for the upcoming "iPhone 8". The technology is rumored to consist of three modules to enable fully-featured 3D sensing capabilities. While there's no way to know for sure if this particular patent describes one of those modules, the upgraded camera system is said to be fueled by PrimeSense algorithms.

Article Link: Apple Face Detection Patent Hints at Possible PrimeSense Tech Headed For 'iPhone 8' ('https://www.macrumors.com/2017/03/07/apple-face-detection-patent-iphone-8/')
Score: 2 Votes (Like | Disagree)
thisisnotmyname Avatar
57 months ago
As [USER=957351]@djcerla[/USER] stipulated in one thread, unlocking with face recognition would likely be a backup/secondary solution for Touch ID. So you can use either or. :)
I really do hope they make facial recognition as an authentication mechanism optional via configuration. I don't want someone being able to unlock my phone by forcing it in front of my face.
Score: 1 Votes (Like | Disagree)
69Mustang Avatar
57 months ago
That picture just looks (descriptively sounds) like the version 1 of the Kinect.
Score: 1 Votes (Like | Disagree)

Top Stories

nothing ear 1 buds 1

Nothing 'Ear (1)' True Wireless Earbuds Launch to Take on AirPods Pro With ANC and Unusual Design for $99

Tuesday July 27, 2021 7:57 am PDT by
Nothing, a new brand from OnePlus founder Carl Pei, has today officially launched the "Ear (1)" true wireless earbuds after months of anticipation around the company's AirPods Pro rival. The Ear (1) features an in-ear design, Active Noise Cancelation, Bluetooth 5.2, IPX4 water resistance, and a charging case with Qi-compatible wireless charging and a USB-C port. Fast pairing is supported on...
iOS 14 on iPhone feature emergency

Apple Releases iOS and iPadOS 14.7.1 With Fix for Touch ID Apple Watch Bug

Monday July 26, 2021 9:48 am PDT by
Apple today released iOS and iPadOS 14.7.1, minor bug fix updates that come just a week after the release of iOS 14.7, software that introduced new Apple Card features and support for the MagSafe Battery Pack. The iOS and iPadOS 14.7.1 updates can be downloaded for free and the software is available on all eligible devices over-the-air in the Settings app. To access the new software, go to...
iPad mini pro feature 2

iPad Mini 6 to Feature 8.3-Inch Display With No Home Button and Narrower Bezels

Monday July 26, 2021 12:26 pm PDT by
The sixth-generation iPad mini that's in the works will have an 8.3-inch display, according to display analyst Ross Young. That will be larger than the current 7.9-inch display, with the larger size due to the removal of the Home button and a narrower bezel design. Rumors about the iPad mini 6 have been picking up in recent weeks ahead of its prospective launch this fall. Apple analyst...
iphone 12 pro gold

Report: iPhone 14 Pro Models to Feature Tough Titanium Alloy Chassis

Monday July 26, 2021 1:12 am PDT by
Next year's "iPhone 14" series is expected to feature high-end models with a new titanium alloy chassis design, claims a new investors report by JP Morgan Chase. According to the report, the use of titanium alloy will be one of the biggest changes to the case design in the 2022 iPhone series, and Foxconn will be the exclusive manufacturer of the titanium frames for the high-end models....
iOS 15 General Feature Purple

Everything New in iOS 15 Beta 4: Safari Tweaks, MagSafe Battery Pack Support, Notification Updates and More

Tuesday July 27, 2021 11:47 am PDT by
Apple today released the fourth betas of iOS 15 and iPadOS 15, introducing additional refinements to the new features that are coming in the software updates. In these betas, Apple has introduced changes for Safari, Notifications, Focus mode, and more. Safari Updates Apple is continuing to refine the design of Safari on the iPhone, and in iOS 15, there are tweaks to improve usability. ...
apple mac business page

Apple Shares 11 Reasons Why Business Users Should Choose Macs

Monday July 26, 2021 11:35 am PDT by
Apple today updated its Apple at Work website with a new section dedicated to the Mac, which offers up 11 reasons why "Mac means business." On the webpage, Apple highlights the M1 chip as the number one reason why business users should choose a Mac, offering up an M1 overview [PDF] that explains the benefits of the M1 chip. The information isn't new, but it does provide a look at all of...
imac with accessories

Larger Redesigned High-End iMac Rumored to Launch Next Year

Monday July 26, 2021 3:45 am PDT by
Apple's larger redesigned iMac will arrive sometime in 2022 rather than later this year, according to the leaker known as "Dylandkt." On Twitter, Dylandkt claimed that Apple's "high end iMac" is not expected to release in the fourth quarter of 2021 alongside Apple's "M1X Macs" – a reference to Apple's redesigned MacBook Pro models – because "Apple simply does not want their devices to...
General iOS 14

iOS 14.7.1 and macOS Big Sur 11.5.1 Patch Security Vulnerability That May Have Been Actively Exploited

Monday July 26, 2021 11:55 am PDT by
Apple today released unexpected iOS 14.7.1 and iPadOS 14.7.1 updates to the public, and according to a newly released support document, the software addresses a serious security vulnerability that may have been exploited in the wild. Apple says that an application may have been able to execute arbitrary code with kernel privileges due to a memory corruption issue. "Apple is aware of a report ...
apple bitcoin hack

Is Apple Really Buying Bitcoin?

Monday July 26, 2021 3:07 am PDT by
A large number of websites and posts on social media are stoking rumors that Apple has purchased $2.5 billion worth of bitcoin in the company's first move into cryptocurrency, but is there any validity to the claims? Many people are citing the fact that Apple was looking for a Business Development Manager with experience in alternative payments, including cryptocurrency, earlier this year as ...
new m1 chip

Tim Cook on Apple Deciding to Manufacture Components: 'We Ask Ourselves If We Can Do Something Better'

Tuesday July 27, 2021 3:04 pm PDT by
During today's earnings call for the third fiscal quarter of 2021 (second calendar quarter), Apple CEO Tim Cook was asked how Apple decides what components to purchase and what components to develop, and Cook said that Apple asks if it can be done better. We ask ourselves if we can do something better. If we can deliver a better product. If we can buy something in the market and it's great...