Apple Glasses Patent Suggests Any Surface Could Become a Virtual Touch Interface

It's been increasingly clear that Apple has been working on an AR/VR Headset for the consumer market. Originally expected as early as 2020, the most recent rumors place its release in 2021 or 2022.

apple touch patent maps
But what's been less clear is the exact feature set a pair of AR/VR Apple Glasses will provide. Rumors have been scattered over the functionality with some internal debate about the direction of the unreleased headset -- ranging from an ultra-powerful wearable product to a more limited accessory for the iPhone.

A newly revealed patent application from Apple uncovered by AppleInsider shows some intriguing research that Apple has been doing into the field as far back as 2016.

In the patent, Apple addresses the question of how someone wearing a pair of Apple Glasses would be able to interact with the mixed virtual/real environment they are looking at. When using an ‌iPhone‌ or iPad as an AR viewfinder, the user would typically tap on the screen to interact with objects shown on the screen. But when wearing an AR headset, the same task would be cumbersome. Previous attempts at directly interacting with an AR environment required additional hardware such as a glove or finger sensors. Meanwhile, trying to visually detect finger-to-surface contact is not accurate enough to be useful.

Apple describes how it can more elegantly accomplish this task by using infrared heat sensing to detect when a user touches a real-world object.

The present disclosure is related to a method and device for detecting a touch between at least part of a first object and at least part of a second object, wherein the at least part of the first object has a different temperature than the at least part of the second object. The method includes providing at least one thermal image of a portion of the second object, determining in at least part of the at least one thermal image a pattern which is indicative of a particular value or range of temperature or a particular value or range of temperature change, and using the determined pattern for detecting a touch between the at least part of the first object and the at least part of the second object.

The method could then allow Apple Glasses to visually project controls onto real-world objects and react when they are touched by the user by sensing the heat transfer when touching the object.

As with all patent applications, we can't be certain Apple will incorporate this technology into its future products. But we do believe Apple is planning on releasing an Apple AR/VR headset. Full details can be found in our Apple Glasses roundup.

Related Roundup: Apple Vision Pro
Tag: Patent
Buyer's Guide: Vision Pro (Buy Now)
Related Forum: Apple Vision Pro

Top Rated Comments

AngerDanger Avatar
48 months ago
Apple's explanation is a little verbose, so to simplify, it seems they could use IR to detect hotpots left by finger taps, and use that as touch input.



If it works out, this is AWESOME!

Attachment Image
Score: 22 Votes (Like | Disagree)
Joniz Avatar
48 months ago
These will go nowhere until they can shoot lasers whenever I give someone a withering stare.
Score: 11 Votes (Like | Disagree)
Sharewaredemon Avatar
48 months ago

Apple's explanation is a little verbose, so to simplify, it seems that Apple could use IR to detect hotpots left by finger taps, and use that as touch input.
Bless you for taking the time to sum up for us all.

Attachment Image
Score: 7 Votes (Like | Disagree)
velocityg4 Avatar
48 months ago
This reminds me of this Dilbert comic from 1994.
('https://dilbert.com/strip/1994-10-12')
Score: 7 Votes (Like | Disagree)
adamdport Avatar
48 months ago

Apple could use IR to detect hotpots left by finger taps, and use that as touch input.
seems like it would be laggy
Score: 5 Votes (Like | Disagree)
Gorms Avatar
48 months ago

Apple's explanation is a little verbose, so to simplify, it seems they could use IR to detect hotpots left by finger taps, and use that as touch input.

If it works out, this is AWESOME!
The patent is old. It’ll use LIDAR. This is why LIDAR is on iPad Pro
Score: 5 Votes (Like | Disagree)

Popular Stories

reset password request iphone

Warning: Apple Users Targeted in Phishing Attack Involving Rapid Password Reset Requests

Tuesday March 26, 2024 4:34 pm PDT by
Phishing attacks taking advantage of Apple's password reset feature have become increasingly common, according to a report from KrebsOnSecurity. Multiple Apple users have been targeted in an attack that bombards them with an endless stream of notifications or multi-factor authentication (MFA) messages in an attempt to cause panic so they'll respond favorably to social engineering. An...
maxresdefault

Apple to Launch New iPad Pro and iPad Air Models in May

Thursday March 28, 2024 11:07 am PDT by
Apple will introduce new iPad Pro and iPad Air models in early May, according to Bloomberg's Mark Gurman. Gurman previously suggested the new iPads would come out in March, and then April, but the timeline has been pushed back once again. Subscribe to the MacRumors YouTube channel for more videos. Apple is working on updates to both the iPad Pro and iPad Air models. The iPad Pro models will...
Generic iOS 18 Feature Purple

iOS 18: What to Expect From 'Biggest' Update in iPhone's History

Wednesday March 27, 2024 11:10 am PDT by
At least some Apple software engineers continue to believe that iOS 18 will be the "biggest" update in the iPhone's history, according to Bloomberg's Mark Gurman. Below, we recap rumored features and changes for the iPhone. "The iOS 18 update is expected to be the most ambitious overhaul of the iPhone's software in its history, according to people working on the upgrade," wrote Gurman, in a r...
maxresdefault

Apple Announces WWDC 2024 Event for June 10 to 14

Tuesday March 26, 2024 10:02 am PDT by
Apple today announced that its 35th annual Worldwide Developers Conference is set to take place from Monday, June 10 to Friday, June 14. As with WWDC events since 2020, WWDC 2024 will be an online event that is open to all developers at no cost. Subscribe to the MacRumors YouTube channel for more videos. WWDC 2024 will include online sessions and labs so that developers can learn about new...
apple maps 3d feature

Apple Maps May Gain Custom Routes With iOS 18

Tuesday March 26, 2024 3:10 pm PDT by
Apple may be planning to add support for "custom routes" in Apple Maps in iOS 18, according to code reviewed by MacRumors. Apple Maps does not currently offer a way to input self-selected routes, with Maps users limited to Apple's pre-selected options, but that may change in iOS 18. Apple has pushed an iOS 18 file to its maps backend labeled "CustomRouteCreation." While not much is revealed...
General iOS 17 Feature Orange Purple

Apple Releases Revised Versions of iOS 17.4.1 and iPadOS 17.4.1 With Updated Build Number

Wednesday March 27, 2024 5:59 am PDT by
Apple on late Tuesday released revised versions of iOS 17.4.1 and iPadOS 17.4.1 with an updated build number of 21E237, according to MacRumors contributor Aaron Perris. The updates previously had a build number of 21E236. The revised updates are available for all iPhone and iPad models that are compatible with iOS 17 and iPadOS 17, but they can only be installed via the Finder app on macOS...
applephilschiller

Apple's Phil Schiller Works 80 Hours a Week Overseeing App Store

Wednesday March 27, 2024 2:03 pm PDT by
With the App Store and app ecosystem undergoing major changes in the European Union, The Wall Street Journal today shared a profile on App Store chief Phil Schiller, who is responsible for the App Store. Though Schiller transitioned from marketing chief to "Apple Fellow" in 2020 to take a step back from Apple and spend more time on personal projects and friends, he is reportedly working...