Apple Glasses Patent Suggests Any Surface Could Become a Virtual Touch Interface

It's been increasingly clear that Apple has been working on an AR/VR Headset for the consumer market. Originally expected as early as 2020, the most recent rumors place its release in 2021 or 2022.


But what's been less clear is the exact feature set a pair of AR/VR Apple Glasses will provide. Rumors have been scattered over the functionality with some internal debate about the direction of the unreleased headset -- ranging from an ultra-powerful wearable product to a more limited accessory for the iPhone.

A newly revealed patent application from Apple uncovered by AppleInsider shows some intriguing research that Apple has been doing into the field as far back as 2016.

In the patent, Apple addresses the question of how someone wearing a pair of ‌Apple Glasses‌ would be able to interact with the mixed virtual/real environment they are looking at. When using an ‌iPhone‌ or iPad as an AR viewfinder, the user would typically tap on the screen to interact with objects shown on the screen. But when wearing an AR headset, the same task would be cumbersome. Previous attempts at directly interacting with an AR environment required additional hardware such as a glove or finger sensors. Meanwhile, trying to visually detect finger-to-surface contact is not accurate enough to be useful.

Apple describes how it can more elegantly accomplish this task by using infrared heat sensing to detect when a user touches a real-world object.

The present disclosure is related to a method and device for detecting a touch between at least part of a first object and at least part of a second object, wherein the at least part of the first object has a different temperature than the at least part of the second object. The method includes providing at least one thermal image of a portion of the second object, determining in at least part of the at least one thermal image a pattern which is indicative of a particular value or range of temperature or a particular value or range of temperature change, and using the determined pattern for detecting a touch between the at least part of the first object and the at least part of the second object.

The method could then allow ‌Apple Glasses‌ to visually project controls onto real-world objects and react when they are touched by the user by sensing the heat transfer when touching the object.

As with all patent applications, we can't be certain Apple will incorporate this technology into its future products. But we do believe Apple is planning on releasing an Apple AR/VR headset. Full details can be found in our Apple Glasses roundup.

Related Roundup: Apple Glasses
Tag: patent

Top Rated Comments

(View all)
Avatar
10 weeks ago
Apple's explanation is a little verbose, so to simplify, it seems they could use IR to detect hotpots left by finger taps, and use that as touch input.



If it works out, this is AWESOME!

Score: 22 Votes (Like | Disagree)
Avatar
10 weeks ago
These will go nowhere until they can shoot lasers whenever I give someone a withering stare.
Score: 11 Votes (Like | Disagree)
Avatar
10 weeks ago


Apple's explanation is a little verbose, so to simplify, it seems that Apple could use IR to detect hotpots left by finger taps, and use that as touch input.

Bless you for taking the time to sum up for us all.

Score: 7 Votes (Like | Disagree)
Avatar
10 weeks ago
This reminds me of this Dilbert comic from 1994.
[IMG alt=" - Dilbert by Scott Adams"]https://assets.amuniversal.com/d63dc6d09f87012f2fe600163e41dd5b[/IMG] ('https://dilbert.com/strip/1994-10-12')
Score: 7 Votes (Like | Disagree)
Avatar
10 weeks ago


Apple could use IR to detect hotpots left by finger taps, and use that as touch input.

seems like it would be laggy
Score: 5 Votes (Like | Disagree)
Avatar
10 weeks ago


Apple's explanation is a little verbose, so to simplify, it seems they could use IR to detect hotpots left by finger taps, and use that as touch input.

If it works out, this is AWESOME!

The patent is old. It’ll use LIDAR. This is why LIDAR is on iPad Pro
Score: 5 Votes (Like | Disagree)

Top Stories

Hands-On With iOS 14 Widgets, Custom Icons, and Home Screen Setup

Tuesday September 22, 2020 3:25 pm PDT by
Apple with iOS 14 introduced widgets on the Home Screen, leading to unprecedented levels of customization for the iPhone. Combined with Shortcuts that let you change an app's icon, iOS 14 lets you create a whole new look for your Home Screen. Subscribe to the MacRumors YouTube channel for more videos. We've been following along with some of the creative alternative Home Screen designs that M...

New Images Leak of iPhone 12 Braided USB-C to Lightning Cable

Thursday September 24, 2020 2:37 am PDT by
Rumors suggest Apple's upcoming iPhone 12 models will ship with a new Lightning to USB-C cable that includes a braided fabric design. Images of the purported cables were leaked in July, and today leaker Mr White has shared new images that give us a closer look at what we might get included in the iPhone 12 box. The photos show a USB-C to Lightning cable with a clearly braided design rather...

Apple's iPhone 12 Event Could Happen on October 13 Based on Rumors From Mobile Operators

Wednesday September 23, 2020 11:51 am PDT by
Apple's upcoming iPhone-centric event could perhaps be held on Tuesday, October 13, according to information shared with MacRumors by an employee at a UK cellular carrier. There's no way for us to confirm the dates at this point in time nor are we sure on the credibility of the source, but even without a rumor, Tuesday, October 13 is a good guess based on Apple's historic launch timelines, ...

New Version of Microsoft Office Coming Next Year That Won't Require a Subscription

Thursday September 24, 2020 1:53 am PDT by
Microsoft will next year offer a new perpetual release of Microsoft Office for Mac and Windows that doesn't require a subscription to use, according to the software giant (via Windows Central). "Microsoft Office will also see a new perpetual release for both Windows and Mac, in the second half of 2021," said Microsoft in a blog post announcing the next version of its Exchange server,...

Interest in iOS 14 Home Screen Ideas Helps Pinterest Break Daily Download Record

Wednesday September 23, 2020 4:37 am PDT by
Apple's introduction of widgets on the Home Screen in iOS 14 has driven a surge in interest among users looking to customize their iPhone, and that has reportedly had a knock-on effect for Pinterest, whose iOS app has seen record downloads as users flock to its content seeking design inspiration. As reported by TechCrunch, App Store intelligence firm Apptopia was first to note the impact of ...

'iPhone 12 mini' Name Reappears in Leaked Apple iPhone 12 Case Stickers

Friday September 25, 2020 1:58 am PDT by
Earlier this week a proven leaker claimed that the iPhone 12 lineup would be named "iPhone 12 mini," "iPhone 12," "iPhone 12 Pro," and "iPhone 12 Pro Max," and today the same nomenclature has appeared again in a photo depicting alleged stickers from unreleased Silicone iPhone cases originating from Apple's international distribution center in Ireland. The photo shows three stickers with the...

Apple Releases iOS 14.0.1 With Fix for Bug That Resets Default Apps After Rebooting

Thursday September 24, 2020 10:12 am PDT by
Apple today released iOS 14.0.1, the first update to the iOS 14 operating system that was released on September 16. Today's update is a bug fix update addressing issues that weren't able to be fixed in the initial iOS 14 launch. The iOS 14.0.1 update is available on all eligible devices over-the-air in the Settings app. To access the new software, go to Settings > General > Software Update. ...

Apple Emphasizes That Solo Loop May Increase in Length Over Time, Updates Sizing Guide With More Specific Instructions

Wednesday September 23, 2020 8:26 am PDT by
Apple on Tuesday updated one of its support documents to emphasize that the new silicone rubber Solo Loop for the Apple Watch may increase in length over time, as mentioned in fine print at the bottom of the Solo Loop product page. Apple has also updated its printable Solo Loop sizing guide with more specific instructions, as noted by 9to5Mac's Michael Steeber. The guide now advises users to ...

iOS 14 Widgets Offer iPhone Users Creative Home Screen Ideas

Sunday September 20, 2020 8:43 pm PDT by
Updated on September 22nd with hands on video. In iOS 14, Apple introduced ‌the concept of Home Screen‌ widgets, which provide information from apps at a glance. Widgets can be pinned to the Home Screen in various spots and sizes, allowing for many different layouts. Despite the relative lack of...

Kuo: Mini-LED Displays to Debut in Apple's Next iPad Pro

Tuesday September 22, 2020 11:45 pm PDT by
Following his report earlier this week indicating that Apple will be accelerating adoption of mini-LED displays in its iPad and Mac notebook lineups thanks to better than expected development from potential secondary supplier Sanan Optoelectronics, analyst Ming-Chi has released a new report today sharing a bit more perspective on the mini-LED display market as it relates to Apple. Kuo says...