Warby Parker App Uses iPhone X TrueDepth Camera to Find Your Ideal Specs

by

Spectacles company Warby Parker recently updated its mobile app to include a novel implementation of Apple's face recognition technology exclusive to the iPhone X.

The glasses app uses the smartphone's front-facing TrueDepth camera to map the user's face and create an ideal fit for a new set of frames.


Apple's Face ID authentication works by projecting 30,000 dots on the surface of a person's face, accurately mapping its curvature and unique features.

The camera's sensors also capture the data in three dimensions, and it's this technology in particular that the glasses app uses to recommend to the user a series of frames that it thinks will fit their facial structure.

The only failing of the app is that it doesn't (yet) place the spectacles on the user's face, Snapchat-style, to let the customer see what they look like wearing them.

Apple's ARKit augmented reality framework would seem to be the obvious solution to this lack. We've reached out to Warby Parker to ask if they have any plans to make use of it, and will update this article if we hear back.

(Via Mashable.)

Top Rated Comments

(View all)
Avatar
34 months ago
This is seriously revolutionary stuff when considering the long game. In five years' time this sort of example will be second nature and we'll never know how we did without it. That's what Apple have fundamentally achieved over the years; great technology that has practical use in real life.

Eventually the 'technology' aspect fades away, becoming part of the every day and ultimately indispensable.
Score: 10 Votes (Like | Disagree)
Avatar
34 months ago
Whilst this is really cool I have to wonder. I'm not a conspiracy theorist and I'm not paranoid, I don't have any trust issues when it comes to using FaceID or TouchID data being sent off to whomever by Apple, but when it comes to 3rd party apps I'm not so sure. Maybe someone can shed some light on this for me. Does the app send the data it mapped to the company? Is this mapping any different from what FaceID does, maybe less accurate?
Score: 8 Votes (Like | Disagree)
Avatar
34 months ago
This seems to contradict what Apple told a Senate committee back in October, when questioned about the accessibility of facial scans and privacy:

“Apple's response to Franken largely restates information available on Apple's website ('https://support.apple.com/en-us/HT208108') about how Face ID works - such as the fact that "faceprints" are not collected by Apple, that third-party developers cannot collect face data from developers, and how the technology works. “. (From Business Insider)

Seems as though third parties can in fact collect face data. Granted It’s with the user’s consent to use the app, but it’s still contrary to what Apple said before.

Am I misunderstanding something here?
Score: 5 Votes (Like | Disagree)
Avatar
34 months ago
This is exactly the sort of thing I’m excited about moving forward.

Warby Parker is already leading the pack in terms of virtual fittings, I can’t wait to see what they do next.

I’ve worn glasses or contacts since I was five (in 1979), and I have not-so-fond memories of trying to see what I looked like with empty frames, yet being so near-sighted that my face had to be within inches of the mirror. Trying on new frames while wearing contacts felt miraculous by the time I got to high school, this is next level stuff.
Score: 4 Votes (Like | Disagree)
Avatar
34 months ago
Exactly what does the EULA state for that app? What can they do with the face data they've collected? I'm pretty certain most people don't read the EULA so...
Score: 3 Votes (Like | Disagree)
Avatar
34 months ago

This seems to contradict what Apple told a Senate committee back in October, when questioned about the accessibility of facial scans and privacy:

“Apple's response to Franken largely restates information available on Apple's website ('https://support.apple.com/en-us/HT208108') about how Face ID works - such as the fact that "faceprints" are not collected by Apple, that third-party developers cannot collect face data from developers, and how the technology works. “. (From Business Insider)

Seems as though third parties can in fact collect face data. Granted It’s with the user’s consent to use the app, but it’s still contrary to what Apple said before.

Am I misunderstanding something here?

As far as I can determine developers have access to true depth information from the camera system, which is different than Face ID data. Apple provides them with the ability to access like 50 or so measurements from the true depth camera system. But they don't have access to any of the Face ID data or the algorithm that creates and checks for Face ID.
Score: 3 Votes (Like | Disagree)

Top Stories

Apple's First MacBook Pro With a Retina Display Will Become 'Obsolete' in 30 Days

Monday June 1, 2020 7:50 am PDT by
If you are still hanging on to a Mid 2012 model of the 15-inch MacBook Pro with a Retina display, and require a new battery or other repairs, be sure to book an appointment with a service provider as soon as possible. In an internal memo today, obtained by MacRumors, Apple has indicated that this particular MacBook Pro model will be marked as "obsolete" worldwide on June 30, 2020, just over...

Five Mac Apps Worth Checking Out - June 2020

Tuesday June 2, 2020 2:25 pm PDT by
Apps developed for the Mac often don't receive as much coverage as apps designed for iPhones and iPads, so we have a series at MacRumors that highlights interesting Mac apps that are worth taking a look at. This month's apps are designed to make working from home a little bit easier. Subscribe to the MacRumors YouTube channel for more videos. Meeter (Free) - Working from home often...

Apple Music Joins Music Industry's Blackout Tuesday Awareness Campaign

Tuesday June 2, 2020 1:31 am PDT by
Apple Music has cancelled its Beats 1 radio schedule for Blackout Tuesday and is suggesting that listeners tune in to a radio stream celebrating the best in black music. Blackout Tuesday is a campaign organized by the music industry to support Black Lives Matter after Minneapolis citizen George Floyd was killed by police in the course of his arrest. On launching Apple Music, many users...

Next Apple Pencil Could Be Released in Black

Tuesday June 2, 2020 10:25 am PDT by
The next iteration of the Apple Pencil could be available in black for the first time, according to leaker Mr. White who shared the tidbit on Twitter this morning. A mockup of an Apple Pencil in black We haven't heard rumors of a next-generation Apple Pencil and it's not clear when a new model might be released. Apple is rumored to be working on mini-LED versions of the iPad Pro, and it's...

iPad Pro With A14X Chip, 5G, and Mini-LED Display Expected in First Half of 2021

Wednesday June 3, 2020 6:22 am PDT by
Apple plans to launch new iPad Pro models with an A14X chip, 5G connectivity, and a Mini-LED display in the first or second quarter of 2021, according to the increasingly reliable Twitter account L0vetodream. The leaker claims that the new iPad Pro models will be equipped with Qualcomm's Snapdragon X55 modem, which supports both mmWave and sub-6GHz. mmWave is a set of 5G frequencies that...

Apple Releases macOS Catalina 10.15.5 Supplemental Update With Security Fix

Monday June 1, 2020 10:56 am PDT by
Apple today released a supplemental update for macOS Catalina 10.15.5, the fifth update to the macOS Catalina operating system that was released in October 2019. The supplemental update comes a week after the release of the macOS Catalina 10.15.5 update. ‌macOS Catalina‌ 10.15.5 is a free update that can be downloaded from the Mac App Store using the Update feature in the System...

Tim Cook Addresses George Floyd's Death and Ensuing Protests and Riots as Apple Temporarily Closes Some U.S. Stores

Sunday May 31, 2020 8:04 pm PDT by
Amid unrest in numerous U.S. cities following last week's killing of George Floyd by police in Minneapolis, Apple CEO Tim Cook has shared an internal memo with employees (via Bloomberg) addressing the pain that many are feeling and urging others to commit "to creating a better, more just world for everyone." Cook also announced that Apple is making donations to several groups challenging...

iCloud Down for Many Users, Causing 'The Application You Have Selected Does Not Exist' Error [Update: Fixed]

Tuesday June 2, 2020 4:44 pm PDT by
iCloud appears to be down for many people at the current time, based on complaints from MacRumors readers and Twitter users. Apple's system status page was not initially displaying an error when the problems started, but has been updated to confirm an issue with iCloud account sign ins. The support site says that some users may be unable to sign in to their iCloud accounts and may also be...

iOS 14 Again Said to Be Compatible With All iPhones Able to Run iOS 13

Monday June 1, 2020 2:08 pm PDT by
iOS 14 will be compatible with all iPhones and iPod touch models able to run iOS 13, according to information shared today by Israeli site The Verifier. The compatibility data was allegedly found in a leaked version of iOS 14 and confirmed by what The Verifier says is a "trusted source from the system development process." iOS 13 is compatible with the iPhone 6s and later, with a full...

iPhone 13 Prototype Mockup Depicts Notch-Free Design and USB-C Port

Thursday June 4, 2020 10:07 am PDT by
We still have a few months to go before Apple unveils the iPhone 12, but rumors about the iPhone 13, coming in fall 2021, are already circulating. Japanese site Mac Otakara today shared a rough 3D printed mockup of a 5.5-inch iPhone said to be coming in 2021, which is from "Alibaba sources." The model may be built on leaked specifications and rumors, but where the info comes from is unclear. ...