Warby Parker App Uses iPhone X TrueDepth Camera to Find Your Ideal Specs

by

Spectacles company Warby Parker recently updated its mobile app to include a novel implementation of Apple's face recognition technology exclusive to the iPhone X.

The glasses app uses the smartphone's front-facing TrueDepth camera to map the user's face and create an ideal fit for a new set of frames.


Apple's Face ID authentication works by projecting 30,000 dots on the surface of a person's face, accurately mapping its curvature and unique features.

The camera's sensors also capture the data in three dimensions, and it's this technology in particular that the glasses app uses to recommend to the user a series of frames that it thinks will fit their facial structure.

The only failing of the app is that it doesn't (yet) place the spectacles on the user's face, Snapchat-style, to let the customer see what they look like wearing them.

Apple's ARKit augmented reality framework would seem to be the obvious solution to this lack. We've reached out to Warby Parker to ask if they have any plans to make use of it, and will update this article if we hear back.

(Via Mashable.)

Top Rated Comments

(View all)
Avatar
38 months ago
This is seriously revolutionary stuff when considering the long game. In five years' time this sort of example will be second nature and we'll never know how we did without it. That's what Apple have fundamentally achieved over the years; great technology that has practical use in real life.

Eventually the 'technology' aspect fades away, becoming part of the every day and ultimately indispensable.
Score: 10 Votes (Like | Disagree)
Avatar
38 months ago
Whilst this is really cool I have to wonder. I'm not a conspiracy theorist and I'm not paranoid, I don't have any trust issues when it comes to using FaceID or TouchID data being sent off to whomever by Apple, but when it comes to 3rd party apps I'm not so sure. Maybe someone can shed some light on this for me. Does the app send the data it mapped to the company? Is this mapping any different from what FaceID does, maybe less accurate?
Score: 8 Votes (Like | Disagree)
Avatar
38 months ago
This seems to contradict what Apple told a Senate committee back in October, when questioned about the accessibility of facial scans and privacy:

“Apple's response to Franken largely restates information available on Apple's website ('https://support.apple.com/en-us/HT208108') about how Face ID works - such as the fact that "faceprints" are not collected by Apple, that third-party developers cannot collect face data from developers, and how the technology works. “. (From Business Insider)

Seems as though third parties can in fact collect face data. Granted It’s with the user’s consent to use the app, but it’s still contrary to what Apple said before.

Am I misunderstanding something here?
Score: 5 Votes (Like | Disagree)
Avatar
38 months ago
This is exactly the sort of thing I’m excited about moving forward.

Warby Parker is already leading the pack in terms of virtual fittings, I can’t wait to see what they do next.

I’ve worn glasses or contacts since I was five (in 1979), and I have not-so-fond memories of trying to see what I looked like with empty frames, yet being so near-sighted that my face had to be within inches of the mirror. Trying on new frames while wearing contacts felt miraculous by the time I got to high school, this is next level stuff.
Score: 4 Votes (Like | Disagree)
Avatar
38 months ago
Exactly what does the EULA state for that app? What can they do with the face data they've collected? I'm pretty certain most people don't read the EULA so...
Score: 3 Votes (Like | Disagree)
Avatar
38 months ago

This seems to contradict what Apple told a Senate committee back in October, when questioned about the accessibility of facial scans and privacy:

“Apple's response to Franken largely restates information available on Apple's website ('https://support.apple.com/en-us/HT208108') about how Face ID works - such as the fact that "faceprints" are not collected by Apple, that third-party developers cannot collect face data from developers, and how the technology works. “. (From Business Insider)

Seems as though third parties can in fact collect face data. Granted It’s with the user’s consent to use the app, but it’s still contrary to what Apple said before.

Am I misunderstanding something here?

As far as I can determine developers have access to true depth information from the camera system, which is different than Face ID data. Apple provides them with the ability to access like 50 or so measurements from the true depth camera system. But they don't have access to any of the Face ID data or the algorithm that creates and checks for Face ID.
Score: 3 Votes (Like | Disagree)

Top Stories

Here's How You Can Download iOS 14 and iPadOS 14 Around the World [It's Out]

Wednesday September 16, 2020 2:36 am PDT by
Apple's official public release of iOS 14 and iPadOS 14 dropped on Wednesday, September 16, just a day after the company released the Golden Master to third-party developers. Also set to be made available to the general public for the first time are watchOS 7 and tvOS 14. Getting Started With iOS 14 Video Click image to watch iOS 14 Getting Started While that's left a lot of developers...

When Will the iPhone 12 Launch? Here's What We Know

Wednesday September 16, 2020 6:12 am PDT by
Yesterday's "Time Flies" Apple event saw the release of the Apple Watch Series 6, Apple Watch SE, iPad 8, and iPad Air 4, but no new iPhone models. Rumors before the event strongly alleged that it would not see the unveiling of new iPhones, with many reports pointing to an October launch. The lack of new iPhone models yesterday seems to confirm that the iPhone 12 lineup will not appear...

Apple Releases iOS 14 and iPadOS 14 With Home Screen Redesign, App Library, Compact UI, Translate App, Scribble Support, App Clips, and More

Wednesday September 16, 2020 12:48 pm PDT by
Apple has released iOS 14 and iPadOS 14, the newest operating system updates designed for the iPhone and iPad. As with all of Apple's software updates, iOS 14 and iPadOS 14 can be downloaded for free. iOS 14 is available on the iPhone 6s and later, while iPadOS 14 is available on the iPad Air 2 and later. The updates are available on all eligible devices over-the-air in the Settings app. To ...

Apple Releases Safari 14 for Mac Ahead of macOS Big Sur Launch

Wednesday September 16, 2020 1:40 pm PDT by
macOS Big Sur didn't launch alongside iOS 14, iPadOS 14, tvOS 14, and watchOS 7 today, with the update coming later this fall, but Apple did release the Safari 14 update for macOS Catalina and macOS Mojave users. Safari 14 brings improved performance, customizable start pages, a Privacy Report to see which cross-site trackers are being blocked, and a new tab bar design that provides tab...

Apple Updates AirPods 2 and AirPods Pro Firmware to Version 3A283

Monday September 14, 2020 11:24 am PDT by
Apple today released new 3A283 firmware updates for the second-generation AirPods and the AirPods Pro. The second-generation AirPods are being updated from the 2D15 firmware they were previously running, while the AirPods Pros are being updated from the 2D27 firmware they had installed previously. Apple does not provide details on what's included in refreshed firmware so we don't know what's ...

iOS 14 Picture in Picture No Longer Working With YouTube's Mobile Website in Safari [Without Premium]

Friday September 18, 2020 12:21 pm PDT by
Apple in iOS 14 added Picture in Picture to the iPhone, a feature designed to let you watch a video in a small screen on your device while you continue to do other things on the phone. When Picture in Picture was working with YouTube The YouTube app doesn't support Picture in Picture, but up until yesterday there was a functional workaround that allowed videos from YouTube.com to be watched...

Hands-On With the New Apple Watch Series 6 and Apple Watch SE

Friday September 18, 2020 1:19 pm PDT by
Today's the official launch date for the Apple Watch Series 6 and the Apple Watch SE, both of which Apple announced on Tuesday. We picked up a couple of the new models and thought we'd give them a quick look for MacRumors readers thinking of ordering a new watch. Apple Watch Series 6 & Apple Watch SE Hands-On! When it comes to design, both the $399 Series 6 and the $279 SE look just like...

iOS 14.2 Beta Adds New Shazam Music Recognition Feature for Control Center

Thursday September 17, 2020 3:36 pm PDT by
Apple today released the first beta of iOS 14.2 to developers for testing purposes, and the new update introduces a Music Recognition control for the Control Center. The new feature lets you discover music playing around you and it recognizes the music playing with in apps, even when you're wearing AirPods. Songs pop up as notifications, and you can tap to listen in Apple Music....

8 Third-Party Home Screen Widgets That You Can Try Out Now on iOS 14

Wednesday August 5, 2020 12:56 pm PDT by
One of the biggest new features of iOS 14 is Home Screen widgets, which provide information from apps at a glance. The widgets can be pinned to the Home Screen in various spots and sizes, allowing for many different layouts. When the iOS 14 beta was first released in June, widgets were limited to Apple's own apps like Calendar and Weather, but several third-party developers have begun to test ...

Apple Releases watchOS 7 With New Watch Faces, Family Setup, Sleep Tracking, Handwashing Help and More

Wednesday September 16, 2020 12:47 pm PDT by
Apple today released watchOS 7, the newest version of the watchOS operating system designed to run on modern Apple Watch models. The watchOS 7 update comes after several months of beta testing. ‌watchOS 7‌ can be downloaded for free through the dedicated Apple Watch app on the iPhone by going to General > Software Update. To install the new software, the Apple Watch needs to have at...