Apple Awarded Patent Detailing Facial Detection and Recognition System for Devices

Apple has been awarded a patent by the U.S. Patent and Trademark Office (via AppleInsider) for a system that allows for a personal computing device such as a Mac or iPhone to be controlled through facial detection and recognition, primarily for security and convenience purposes.

The patent, which was filed back in 2008, introduces itself by describing the problem with the interaction between users and current electronics, stating that devices such as computers inconvenience the user by requiring action in order to continue operating without interruption, along with detailing the security hazard that comes with the inability of passwords to detect a truly authorized user.


The facial recognition and detection system is broken up into three separate parts, and includes a face detection decision application, a face recognition application, and an input/output control manager, all working with an image sensor to determine whether a user is authorized to control a device.

In a further aspect, a personal media device includes an image sensor that captures one or more images. The device includes a data store having at least one known face pattern that is associated with an authorized user of the media device. The device includes a processor that detects one or more faces in the captured images, recognizes at least one of faces as the face of the authorized user by comparing the one or faces with the data store, and controlling the operation of an application of the device in response to recognizing at least one of the faces as the face of the authorized user.

An incoming phone call is cited as an example scenario that could benefit from a facial recognition and detection system, with the system keeping the screen off and only giving off a ringtone or vibration alert if a user is not authorized compared to displaying a normal call screen for an authorized user. The same principle is applied to an incoming email, where a message can be hidden if an unauthorized user is detected.

The patent also details a number of examples as to what information the facial detection and recognition system cites in authorizing users, with information such as visual facial features and background being matched up against stored information to determine whether control of a device can be accessed or not.

It is unknown exactly how or even whether Apple plans to utilize this technology in its products, but competitors such as Samsung and Google have already touted simple facial recognition as key features in their products. Apple also recently completed its acquisition of 3D body sensing firm PrimeSense, and while the system detailed in the patent differs from the firm's image sensing technology, both could be used as part of a bigger initiative by Apple to better integrate human recognition into its products.

This is also not the first time evidence of Apple's interest in face recognition has surfaced, with other patent applications addressing similar concepts while the company acquired Swedish face recognition firm Polar Rose back in 2010.