Apple Glasses Patent Suggests Any Surface Could Become a Virtual Touch Interface

It's been increasingly clear that Apple has been working on an AR/VR Headset for the consumer market. Originally expected as early as 2020, the most recent rumors place its release in 2021 or 2022.

apple touch patent maps
But what's been less clear is the exact feature set a pair of AR/VR Apple Glasses will provide. Rumors have been scattered over the functionality with some internal debate about the direction of the unreleased headset -- ranging from an ultra-powerful wearable product to a more limited accessory for the iPhone.

A newly revealed patent application from Apple uncovered by AppleInsider shows some intriguing research that Apple has been doing into the field as far back as 2016.

In the patent, Apple addresses the question of how someone wearing a pair of ‌Apple Glasses‌ would be able to interact with the mixed virtual/real environment they are looking at. When using an ‌iPhone‌ or iPad as an AR viewfinder, the user would typically tap on the screen to interact with objects shown on the screen. But when wearing an AR headset, the same task would be cumbersome. Previous attempts at directly interacting with an AR environment required additional hardware such as a glove or finger sensors. Meanwhile, trying to visually detect finger-to-surface contact is not accurate enough to be useful.

Apple describes how it can more elegantly accomplish this task by using infrared heat sensing to detect when a user touches a real-world object.

The present disclosure is related to a method and device for detecting a touch between at least part of a first object and at least part of a second object, wherein the at least part of the first object has a different temperature than the at least part of the second object. The method includes providing at least one thermal image of a portion of the second object, determining in at least part of the at least one thermal image a pattern which is indicative of a particular value or range of temperature or a particular value or range of temperature change, and using the determined pattern for detecting a touch between the at least part of the first object and the at least part of the second object.

The method could then allow ‌Apple Glasses‌ to visually project controls onto real-world objects and react when they are touched by the user by sensing the heat transfer when touching the object.

As with all patent applications, we can't be certain Apple will incorporate this technology into its future products. But we do believe Apple is planning on releasing an Apple AR/VR headset. Full details can be found in our Apple Glasses roundup.

Related Roundup: Apple Glasses
Tag: patent

Top Rated Comments

AngerDanger Avatar
10 months ago
Apple's explanation is a little verbose, so to simplify, it seems they could use IR to detect hotpots left by finger taps, and use that as touch input.



If it works out, this is AWESOME!

Attachment Image
Score: 22 Votes (Like | Disagree)
Joniz Avatar
10 months ago
These will go nowhere until they can shoot lasers whenever I give someone a withering stare.
Score: 11 Votes (Like | Disagree)
Sharewaredemon Avatar
10 months ago

Apple's explanation is a little verbose, so to simplify, it seems that Apple could use IR to detect hotpots left by finger taps, and use that as touch input.
Bless you for taking the time to sum up for us all.

Attachment Image
Score: 7 Votes (Like | Disagree)
velocityg4 Avatar
10 months ago
This reminds me of this Dilbert comic from 1994.
[IMG alt=" - Dilbert by Scott Adams"]https://assets.amuniversal.com/d63dc6d09f87012f2fe600163e41dd5b[/IMG] ('https://dilbert.com/strip/1994-10-12')
Score: 7 Votes (Like | Disagree)
adamdport Avatar
10 months ago

Apple could use IR to detect hotpots left by finger taps, and use that as touch input.
seems like it would be laggy
Score: 5 Votes (Like | Disagree)
Gorms Avatar
10 months ago

Apple's explanation is a little verbose, so to simplify, it seems they could use IR to detect hotpots left by finger taps, and use that as touch input.

If it works out, this is AWESOME!
The patent is old. It’ll use LIDAR. This is why LIDAR is on iPad Pro
Score: 5 Votes (Like | Disagree)

Top Stories

siir apple event april 20

Siri Reveals Apple Event Planned for Tuesday, April 20

Tuesday April 13, 2021 12:04 am PDT by
Siri has apparently prematurely revealed that Apple plans to hold an event on Tuesday, April 20, where the company is expected to reveal brand new iPad Pro models and possibly its long-awaited AirTags trackers. Subscribe to the MacRumors YouTube channel for more videos. Upon being asked "When is the next Apple Event," Siri is currently responding with, "The special event is on Tuesday, April...
apple event spring loaded

Apple's 'Spring Loaded' Event Officially Announced for Tuesday, April 20

Tuesday April 13, 2021 9:04 am PDT by
Following an overnight leak by Siri, Apple today officially announced that it will be holding a special "Spring Loaded" event on Tuesday, April 20 at 10:00 a.m. Pacific Time at the Steve Jobs Theater on the Apple Park campus in Cupertino, California. As with all of Apple's 2020 events, the April 2021 event will be a digital-only gathering with no members of the media invited to attend in...
pixel watch prosser leak

Google Pixel Watch Allegedly Leaks with Circular Design, Rumored to Launch in October

Monday April 12, 2021 2:49 am PDT by
Renders of Google's first smartwatch, codenamed "Rohan," have been shared by Jon Prosser, showing that Google plans to adopt a circular design for its flagship wearable watch. Prosser shared the renders in an episode of his YouTube show "Front Page Tech," in which he claims they were made based on marketing material he had seen from a source within Google. The renders show that the Pixel...
Google maps feaure green

Google Maps App for iOS Finally Updated After Four Months

Monday April 12, 2021 10:03 am PDT by
Following the completed rollout of App Privacy labels for its App Store apps, Google today updated the Google Maps app for the first time in four months. Apple in December began requiring all new app submissions and app updates to include App Privacy labels, detailing the data that is collected by the app so consumers know what they're sharing. Google didn't begin implementing App Privacy ...
AppleTV and HomePod Feature

Bloomberg: Apple Working on New Apple TV With Integrated HomePod Speaker and FaceTime Camera

Monday April 12, 2021 3:32 am PDT by
Apple is working on a combined Apple TV with HomePod speaker that has a camera for video calls through a connected television set, according to Bloomberg's Mark Gurman. From the report: The company is working on a product that would combine an Apple TV set-top box with a HomePod speaker and include a camera for video conferencing through a connected TV and other smart-home functions,...
samsung experience 1

Samsung's 'iTest' Lets You Try a Galaxy Device on Your iPhone

Thursday April 8, 2021 12:42 pm PDT by
Samsung has launched "iTest," an interactive website experience that's designed to allow iPhone users to test out Android on a Galaxy device, or "sample the other side," as Samsung puts it. Subscribe to the MacRumors YouTube channel for more videos. The iTest website is being advertised in New Zealand, according to a MacRumors reader who came across the feature. Visiting the iTest website on...
epic iap feature 3

Tim Cook Says App Store Would Become a 'Flea Market' if Third-Party Payment Systems Were Allowed

Monday April 12, 2021 9:41 am PDT by
In a recent interview with the Toronto Star, Apple CEO Tim Cook spoke about a wide variety of topics, ranging from App Tracking Transparency to Apple's ongoing legal battle over App Store policies with Fortnite creator Epic Games. Notably, Cook said that Epic Games' desire for Apple to let developers offer their own payment systems in apps "would make the App Store a flea market":At the...
tim cook toronto star

Tim Cook Says Apple is 'Not Against Digital Advertising' Ahead of iOS 14.5 Launch With App Tracking Transparency

Monday April 12, 2021 8:00 am PDT by
Starting with iOS 14.5, iPadOS 14.5, and tvOS 14.5, Apple will be requiring apps to receive a user's permission to track their activity for targeted advertising purposes, as part of a privacy measure known as App Tracking Transparency. Ahead of App Tracking Transparency being enforced, Apple CEO Tim Cook has participated in a privacy-focused interview with the Toronto Star, telling the...
a13 bionic mockup

Apple Made Sudden Security Changes to its Chips in Fall 2020

Monday April 12, 2021 8:15 am PDT by
Apple made unusual mid-production hardware changes to the A12, A13, and S5 processors in its devices in the fall of 2020 to update the Secure Storage Component, according to Apple Support documents. According to an Apple Support page, spotted by Twitter user Andrew Pantyukhin, Apple changed the Secure Enclave in a number of products in the fall of 2020:Note: A12, A13, S4, and S5 products...
HomePod G4 Feature

Bloomberg: Future HomePod May Feature iPad Connected Via Robotic Arm to Track Users Around The Room During FaceTime Calls

Monday April 12, 2021 3:50 am PDT by
In a report outlining a possible Apple TV with a combined HomePod and camera, Bloomberg's Mark Gurman says that Apple is exploring a future high-end HomePod speaker that could include an iPad connected via a robotic arm that tracks and follows users around a room. From the report: The Cupertino, California-based technology giant, is also mulling the launch of a high-end speaker with a touch ...