Apple Glasses Patent Suggests Any Surface Could Become a Virtual Touch Interface

It's been increasingly clear that Apple has been working on an AR/VR Headset for the consumer market. Originally expected as early as 2020, the most recent rumors place its release in 2021 or 2022.

apple touch patent maps
But what's been less clear is the exact feature set a pair of AR/VR Apple Glasses will provide. Rumors have been scattered over the functionality with some internal debate about the direction of the unreleased headset -- ranging from an ultra-powerful wearable product to a more limited accessory for the iPhone.

A newly revealed patent application from Apple uncovered by AppleInsider shows some intriguing research that Apple has been doing into the field as far back as 2016.

In the patent, Apple addresses the question of how someone wearing a pair of ‌Apple Glasses‌ would be able to interact with the mixed virtual/real environment they are looking at. When using an ‌iPhone‌ or iPad as an AR viewfinder, the user would typically tap on the screen to interact with objects shown on the screen. But when wearing an AR headset, the same task would be cumbersome. Previous attempts at directly interacting with an AR environment required additional hardware such as a glove or finger sensors. Meanwhile, trying to visually detect finger-to-surface contact is not accurate enough to be useful.

Apple describes how it can more elegantly accomplish this task by using infrared heat sensing to detect when a user touches a real-world object.

The present disclosure is related to a method and device for detecting a touch between at least part of a first object and at least part of a second object, wherein the at least part of the first object has a different temperature than the at least part of the second object. The method includes providing at least one thermal image of a portion of the second object, determining in at least part of the at least one thermal image a pattern which is indicative of a particular value or range of temperature or a particular value or range of temperature change, and using the determined pattern for detecting a touch between the at least part of the first object and the at least part of the second object.

The method could then allow ‌Apple Glasses‌ to visually project controls onto real-world objects and react when they are touched by the user by sensing the heat transfer when touching the object.

As with all patent applications, we can't be certain Apple will incorporate this technology into its future products. But we do believe Apple is planning on releasing an Apple AR/VR headset. Full details can be found in our Apple Glasses roundup.

Related Roundup: AR/VR Headset
Tag: Patent

Top Rated Comments

AngerDanger Avatar
37 months ago
Apple's explanation is a little verbose, so to simplify, it seems they could use IR to detect hotpots left by finger taps, and use that as touch input.



If it works out, this is AWESOME!

Attachment Image
Score: 22 Votes (Like | Disagree)
Joniz Avatar
37 months ago
These will go nowhere until they can shoot lasers whenever I give someone a withering stare.
Score: 11 Votes (Like | Disagree)
Sharewaredemon Avatar
37 months ago

Apple's explanation is a little verbose, so to simplify, it seems that Apple could use IR to detect hotpots left by finger taps, and use that as touch input.
Bless you for taking the time to sum up for us all.

Attachment Image
Score: 7 Votes (Like | Disagree)
velocityg4 Avatar
37 months ago
This reminds me of this Dilbert comic from 1994.
('https://dilbert.com/strip/1994-10-12')
Score: 7 Votes (Like | Disagree)
adamdport Avatar
37 months ago

Apple could use IR to detect hotpots left by finger taps, and use that as touch input.
seems like it would be laggy
Score: 5 Votes (Like | Disagree)
Gorms Avatar
37 months ago

Apple's explanation is a little verbose, so to simplify, it seems they could use IR to detect hotpots left by finger taps, and use that as touch input.

If it works out, this is AWESOME!
The patent is old. It’ll use LIDAR. This is why LIDAR is on iPad Pro
Score: 5 Votes (Like | Disagree)

Popular Stories

iOS 17 Icon Mock Feature Feature

iOS 17 Lock Screen Interface to Turn iPhone Into Smart Home Display

Wednesday May 24, 2023 9:47 am PDT by
An updated Lock Screen interface in iOS 17 will turn the iPhone into a "smart-home display," according to Bloomberg's Mark Gurman. When not in use and positioned in a horizontal orientation, the iPhone will show information that includes calendar appointments, weather data, notifications, and more, allowing it to serve as a home data hub. With the iPhone attached to a MagSafe charging stand...
iOS 17 on Phone Feature

iOS 17 Said to Feature Wallet, Find My, SharePlay, and AirPlay Upgrades

Wednesday May 24, 2023 9:59 am PDT by
Apple's upcoming iOS 17 update for the iPhone will include improvements across several apps and features, including Wallet, Find My, SharePlay, and AirPlay, according to Bloomberg's Mark Gurman. Apple is expected to preview iOS 17 during its WWDC keynote on June 5, and the update should be released to all users in September. In a report today, Gurman said the Wallet app in particular will...
wwdc 2023

Apple Announces WWDC 2023 Schedule, Including Keynote Time

Tuesday May 23, 2023 9:03 am PDT by
Apple today announced the schedule for its annual developers conference WWDC, which runs from June 5 through June 9. The schedule confirms that Apple's keynote will begin on June 5 at 10 a.m. Pacific Time, with the company expected to announce iOS 17, macOS 14, watchOS 10, its long-awaited AR/VR headset, a 15-inch MacBook Air, and more. Apple's keynote will be followed by the Platforms State ...
iOS 17 Mock Health Feature Blue

iOS 17 to Include Dedicated Journaling App and Mood Tracking

Wednesday May 24, 2023 10:05 am PDT by
The iOS 17 update that Apple plans to announce in June will include a dedicated journaling app, reports Bloomberg's Mark Gurman. The Wall Street Journal in April highlighted Apple's work on a Day One-style journaling app, but at the time, it was not clear if it would come in iOS 17. According to Gurman, the app is indeed slated for inclusion in iOS 17, and it will introduce "note taking and...
icloud photos

Apple's 'My Photo Stream' Service Shutting Down in July 2023

Friday May 26, 2023 11:51 am PDT by
Apple's "My Photo Stream" service is set to shut down on July 26, 2023, which means customers who are still using that feature will need to transition to using iCloud Photos prior to that date. My Photo Stream is a free service that uploads the last 30 days of images (up to 1,000) to iCloud, making them accessible on the iPhone, iPad, iPod touch, Mac, and PC. It predates iCloud Photos and...
mac mini green

Apple Now Selling Refurbished 2023 M2 Mac Mini Models

Wednesday May 24, 2023 12:34 pm PDT by
Apple today added refurbished M2 Mac mini models to its online store in the United States, offering the latest 2023 version of the desktop machine at a discounted price for the first time. Refurbished M2 Mac mini models are priced starting at $509 for the version with an 8-core CPU, 10-core GPU, 8GB RAM, and 256GB SSD. That's a $90 discount off of the original $599 price tag for that...
chatgpt for iphone feature

OpenAI's Official ChatGPT App for iPhone Expands to 40+ Countries

Thursday May 25, 2023 1:43 pm PDT by
OpenAI this week announced that its official ChatGPT app for the iPhone and the iPad is now available in more than 40 countries in addition to the United States. The app first launched in the United States last week, and OpenAI promised that it would expand to more countries in the coming weeks. As of today, the app can be used in Albania, Algeria, Argentina, Azerbaijan, Bolivia, Brazil,...
iOS 16

iOS 16.5 Now Available for Your iPhone With These New Features

Monday May 22, 2023 12:12 pm PDT by
Following around seven weeks of beta testing, iOS 16.5 was released to the public last week. The software update is a minor one, but includes a few new features and changes for the iPhone. To install an iOS update, open the Settings app on the ‌iPhone‌, tap General → Software Update, and follow the on-screen instructions. Below, we have recapped new features and changes in iOS 16.5,...