Apple Glasses Patent Suggests Any Surface Could Become a Virtual Touch Interface

It's been increasingly clear that Apple has been working on an AR/VR Headset for the consumer market. Originally expected as early as 2020, the most recent rumors place its release in 2021 or 2022.


But what's been less clear is the exact feature set a pair of AR/VR Apple Glasses will provide. Rumors have been scattered over the functionality with some internal debate about the direction of the unreleased headset -- ranging from an ultra-powerful wearable product to a more limited accessory for the iPhone.

A newly revealed patent application from Apple uncovered by AppleInsider shows some intriguing research that Apple has been doing into the field as far back as 2016.

In the patent, Apple addresses the question of how someone wearing a pair of ‌Apple Glasses‌ would be able to interact with the mixed virtual/real environment they are looking at. When using an ‌iPhone‌ or iPad as an AR viewfinder, the user would typically tap on the screen to interact with objects shown on the screen. But when wearing an AR headset, the same task would be cumbersome. Previous attempts at directly interacting with an AR environment required additional hardware such as a glove or finger sensors. Meanwhile, trying to visually detect finger-to-surface contact is not accurate enough to be useful.

Apple describes how it can more elegantly accomplish this task by using infrared heat sensing to detect when a user touches a real-world object.

The present disclosure is related to a method and device for detecting a touch between at least part of a first object and at least part of a second object, wherein the at least part of the first object has a different temperature than the at least part of the second object. The method includes providing at least one thermal image of a portion of the second object, determining in at least part of the at least one thermal image a pattern which is indicative of a particular value or range of temperature or a particular value or range of temperature change, and using the determined pattern for detecting a touch between the at least part of the first object and the at least part of the second object.

The method could then allow ‌Apple Glasses‌ to visually project controls onto real-world objects and react when they are touched by the user by sensing the heat transfer when touching the object.

As with all patent applications, we can't be certain Apple will incorporate this technology into its future products. But we do believe Apple is planning on releasing an Apple AR/VR headset. Full details can be found in our Apple Glasses roundup.

Related Roundup: Apple Glasses
Tag: patent

Top Rated Comments

(View all)
Avatar
2 weeks ago
Apple's explanation is a little verbose, so to simplify, it seems they could use IR to detect hotpots left by finger taps, and use that as touch input.



If it works out, this is AWESOME!

Score: 22 Votes (Like | Disagree)
Avatar
2 weeks ago
These will go nowhere until they can shoot lasers whenever I give someone a withering stare.
Score: 11 Votes (Like | Disagree)
Avatar
2 weeks ago


Apple's explanation is a little verbose, so to simplify, it seems that Apple could use IR to detect hotpots left by finger taps, and use that as touch input.

Bless you for taking the time to sum up for us all.

Score: 7 Votes (Like | Disagree)
Avatar
2 weeks ago
This reminds me of this Dilbert comic from 1994.
[IMG alt=" - Dilbert by Scott Adams"]https://assets.amuniversal.com/d63dc6d09f87012f2fe600163e41dd5b[/IMG] ('https://dilbert.com/strip/1994-10-12')
Score: 7 Votes (Like | Disagree)
Avatar
2 weeks ago


Apple could use IR to detect hotpots left by finger taps, and use that as touch input.

seems like it would be laggy
Score: 5 Votes (Like | Disagree)
Avatar
2 weeks ago


Apple's explanation is a little verbose, so to simplify, it seems they could use IR to detect hotpots left by finger taps, and use that as touch input.

If it works out, this is AWESOME!

The patent is old. It’ll use LIDAR. This is why LIDAR is on iPad Pro
Score: 5 Votes (Like | Disagree)

Top Stories

Apple Confirms This Year's iPhone 12 Models Will Be a Little Bit Late

Thursday July 30, 2020 2:34 pm PDT by
During today's earnings call covering the third fiscal quarter of 2020 (second calendar quarter) Apple CFO Luca Maestri confirmed that Apple is expecting to release this year's iPhones later than usual. Maestri said that Apple last year started selling iPhones in late September, but this year, Apple projects supply will be "available a few weeks later." Multiple rumors have suggested that ...

Just How Small Will the 5.4-Inch iPhone 12 Screen Be? Try It Out for Yourself

Tuesday July 28, 2020 12:57 pm PDT by
As rumors of the iPhone 12 have continued to build over the past few months, the one model that has the most excitement around it is the smallest 5.4" model. The iPhone 12 is believed to be coming in 5.4", 6.7", and 6.1" sizes. Dummy models have shown how much smaller the 5.4" is compared to the rest of the iPhone lineup. The upcoming 5.4" iPhone falls in-between the size of the original...

Leaker Jon Prosser Claims iPhone 12 and New iPads Will Launch in October

Wednesday July 29, 2020 4:15 pm PDT by
Leaker Jon Prosser, who has a somewhat mixed track record when it comes to predicting Apple's plans, today said that new iPhone 12 models and new iPads will launch in October. Multiple rumors have suggested that some or all of the iPhone 12 models coming this year will see a later than normal launch. Apple typically unveils and releases new iPhones in the month of September, but problems...

Apple Watch Series 6 to Feature Blood Oxygen Monitoring Sensor

Friday July 31, 2020 1:56 am PDT by
The Apple Watch Series 6 will add blood oxygen monitoring to its features list when it's launched later this year, according to a new report from DigiTimes. Apple Watch 6 will feature biosensors that can monitor sleeping conditions, detect blood oxygen and measure pulse rates, heartbeats and atrial fibrillation, and will also incorporate MEMS-based accelerometer and gyroscope, all allowing the ...

Emails Reveal Why Steve Jobs and Phil Schiller Blocked In-App Purchase of Kindle Books

Friday July 31, 2020 6:25 am PDT by
Internal Apple emails, made public by the House Judiciary Committee's antitrust inquiry, have revealed information about why Apple blocked in-app purchases of Kindle books on iOS devices, reports The Verge. Two sets of emails between Steve Jobs, Phil Schiller, Eddy Cue, and various other senior Apple executives, disclose the exact thinking behind how Apple approached Kindle on iOS. The...

Apple Launches New Gift Card for 'Everything Apple'

Friday July 31, 2020 3:45 am PDT by
Apple has introduced a new single gift card in the U.S. for all things Apple. First spotted by iCulture, the card can be used at the App Store and other online services, but you can also use it to buy products and accessories in the Apple Store. Previously, there were two separate Apple gift cards available: iTunes cards, which can be used for App Store, iTunes Store, and iCloud storage...

Apple Reports 3Q 2020 Results: $11.25B Profit on $59.7B Revenue, 4-for-1 Stock Split Announced

Thursday July 30, 2020 1:39 pm PDT by
Apple today announced financial results for the third fiscal quarter of 2020, which corresponds to the second calendar quarter of the year. For the quarter, Apple posted revenue of $59.7 billion and net quarterly profit of $11.25 billion, or $2.58 per diluted share, compared to revenue of $53.8 billion and net quarterly profit of $10.0 billion, or $2.18 per diluted share, in the year-ago...

Battery Likely for Upcoming Apple Watch Series 6 Filed in Certification Listings

Saturday August 1, 2020 5:46 am PDT by
A battery likely for the upcoming Apple Watch Series 6 has been filed at the Korea Testing and Research Institute and discovered by a Twitter user @yabhishekhd. Certification for a 1.17Wh battery with a capacity of 303.8mAh was issued on June 23 by the KTR, a Korean regulatory body that approves and tests new hardware ahead of public sale. The battery seems to be destined for a future...

Some Apple Watch Series 5 Owners Seeing Issues With Inconsistent Battery Levels and Random Shutdowns

Thursday July 30, 2020 12:29 pm PDT by
Some Apple Watch Series 5 owners have been experiencing battery issues with their devices that cause random shutdowns even when the Apple Watch is reporting high battery levels. An inconsistent reading of actual battery level appears to be at fault, as in most cases, the Apple Watch reports near 100 percent battery levels for most of the day before dropping down to close to 50 percent and...

Apple Offered to Halve App Store Fee to Get Amazon Prime Video on iOS and Apple TV

Thursday July 30, 2020 6:27 am PDT by
Apple offered Amazon lower App Store fees to convince it to launch its Prime Video app on the App Store and Apple TV, documents published by the U.S. antitrust subcommittee have revealed. According to email correspondence between Apple's services chief Eddy Cue and Amazon CEO Jeff Bezos, Apple struck a deal to bring Amazon Prime Video into the App Store by agreeing to take a 15% revenue share...