Kuo: Apple AR Headset to Feature Advanced Hand Gesture Controls and Object Detection

Apple's long rumored AR headset is predicted to include multiple highly sensitive 3D sensing modules in order to offer an innovative hand gesture and object detecting user interface, according to Apple analyst Ming-Chi Kuo in a new research note obtained by MacRumors.

apple view concept right corner

Antonio De Rosa concept render

We predict that the structured light of the AR/MR headset can detect not only the position change of the user or other people’s hand and object in front of the user's eyes but also the dynamic detail change of the hand (just like the iPhone's Face ID/structured light/Animoji can detect user's dynamic expression change). Capturing the details of hand movement can provide a more intuitive and vivid human-machine UI (for example, detecting the user's hand from a clenched fist to open and the balloon [image] in hand flying away).

Kuo describes the ability for the headset to detect both hand gestures and movements to provide the user with an immersive experience where the user could open their hand to let go of a virtual balloon.

In order to accomplish this impressive feat, Apple is expected to incorporate four sets of 3D sensors which are of higher quality and specifications than the current iPhones. Kuo sees the quality of this human-machine user interface as the key to the success of Apple's upcoming AR headset. According to Kuo, these interface abilities include gesture control, object detection, as well as eye tracking, iris recognition, voice control, skin detection, expression detection, and spatial detection.

Earlier this year, Patently Apple pointed out a patent application from Apple titled "Devices, Methods, and Graphical User Interfaces for Interacting with Three-Dimensional Environments," which details this same concept.

Different movements and locations of the micro-gestures and various movement parameters are used to determine the operations that are performed in the three-dimensional environment. Using the cameras to capture the micro-gestures to interact with the three-dimensional environment allow the user to freely move about the physical environment without be encumbered by physical input equipment, which allows the user to explore the three-dimensional environment more naturally and efficiently.

Apple is widely expected to launch its first-generation AR-focused device in 2022.

Related Roundup: Apple Glasses

Top Rated Comments

arn Avatar
13 months ago

Sounds like iron man stuff.
I was thinking Minority Report, but maybe that just shows my age. :)

Score: 16 Votes (Like | Disagree)
TheYayAreaLiving ? Avatar
13 months ago

I was thinking Minority Report, but maybe that just shows my age. :)


Pretty much sums it up. At least the concept is the same.

[MEDIA=giphy]SLBr5yLzocSYw[/MEDIA]

[MEDIA=giphy]hHxTQkcjmHUTC[/MEDIA]
Score: 10 Votes (Like | Disagree)
boss.king Avatar
13 months ago
Did someone say advanced object recognition?



Attachment Image
Score: 8 Votes (Like | Disagree)
TheYayAreaLiving ? Avatar
13 months ago
Sounds like iron man stuff. True inspiration comes from this.



After having Apple AR glasses on...



Attachment Image

Attachment Image
Score: 7 Votes (Like | Disagree)
topdrawer Avatar
13 months ago
omg, i love making hand gestures.
Score: 5 Votes (Like | Disagree)
MayaUser Avatar
13 months ago

omg, i love making hand gestures.
making hand gestures in your car or on the street...the other people will love this
Score: 3 Votes (Like | Disagree)

Related Stories

apple ar headset concept 2

Apple's Rumored $3,000+ AR/VR Headset Said to Enter Mass Production in August-September

Tuesday February 22, 2022 12:49 am PST by
Apple's first AR/VR headset will enter mass production this fall with a launch taking place before the end of the year, according to industry sources cited today in a report from DigiTimes. Concept render based on purported leaked information by Ian Zelbo Yesterday, DigiTimes previewed a report stating that Apple's headset has completed production tests, and now, in the full report published...
apple mixed reality headset mockup feature purple

Kuo: Apple AR Headset Coming in Late 2022 With Mac-Level Computing Power

Thursday November 25, 2021 8:32 pm PST by
Apple's long-rumored augmented reality (AR) headset project is set to bear its first fruit late next year with the launch of the first device carrying a pair of processors to support its high-end capabilities, according to a new research report from noted analyst Ming-Chi Kuo seen by MacRumors. According to Kuo, the higher-end main processor is said to be similar to the M1 chip Apple...
apple mixed reality headset mockup feature purple

Kuo: Apple's Headset Coming End of 2022, Will Feature 'Pancake' Lenses

Tuesday January 4, 2022 9:29 pm PST by
Apple's widely-rumored AR/VR headset is coming at the end of 2022, with shipments to ramp up in the first quarter of 2023, according to analyst Ming-Chi Kuo. In a research note with TF International Securities, obtained by MacRumors, Kuo said Apple's headset will feature two "3P pancake lenses," which have a folded design that allows light to reflect back and forth between the display and...
apple ar headset concept 2

Apple Reportedly Completes Production Tests for AR/VR Headset

Monday February 21, 2022 7:49 am PST by
Apple has completed key production tests for its long-rumored augmented reality (AR) and virtual reality (VR) headset, according to DigiTimes. Concept render based on purported leaked information by Ian Zelbo Citing information from the headset's component suppliers, the device has reportedly completed second-phase engineering validation tests (EVT 2) to ensure that prototype units meet...
apple ar headset concept 1

Apple AR/VR Headset Potentially Delayed Until 2023 Amid Development Problems

Friday January 14, 2022 8:10 am PST by
Apple's long-rumored AR/VR headset could be delayed until 2023 after being beset with issues during the development process, according to Bloomberg. Concept render based on purported leaked information by Ian Zelbo Citing people familiar with Apple's plans, the report claims that Apple originally planned to launch the headset in 2021 and ship it this year. The company then set its sights on...
apple mixed reality headset mockup feature purple

Report: Apple AR Headset With Rumored $2,000+ Price Tag to Enter Mass Production in Second Quarter of 2022

Wednesday September 22, 2021 6:17 am PDT by
Apple's augmented reality headset will enter mass production in the second quarter of next year, with a launch expected between the third and fourth quarter of 2022, according to a translated report from the Taiwanese version of DigiTimes. In June, Apple analyst Ming-Chi Kuo offered a similar timeline for Apple's AR headset, reporting it will launch sometime between April and June of next...
apple mixed reality headset mockup feature yellow

Apple AR Headset 'Approaching Liftoff' as Development Mirrors Period Before Apple Watch Launch

Tuesday November 16, 2021 8:20 am PST by
Apple's development of its rumored augmented reality (AR) headset is beginning to mirror the period before the launch of the Apple Watch, according to Morgan Stanley analysts. In a note to investors, seen by Investor's Business Daily, Morgan Stanley analysts explained that after years of building expertise and a number of setbacks, Apple's long-awaited AR headset is "approaching liftoff."...
apple mixed reality headset mockup feature purple

Kuo: Second-Generation Apple AR Headset to Launch in 2024 With Lighter Design, Redesigned Battery System, and More

Tuesday December 7, 2021 11:27 pm PST by
Apple is already working on its second-generation AR headset, which will feature a lighter design, adopt a new battery system, and a faster processor, Apple analyst Ming-Chi Kuo said today in an investor note obtained by MacRumors. Apple is widely expected to launch its first-generation AR-focused device in 2022. That device has been previously reported to feature a processor with Mac-level...

Popular Stories

Cyber Monday Deals Feature 2022

Best Cyber Monday Apple Deals Still Available for AirPods, Apple TV, iPad, and More

Monday November 28, 2022 5:24 am PST by
The Black Friday and Cyber Monday holiday shopping rush is drawing to a close, but there are still some good deals to be had out there. For Apple products, many of the deals you've seen since last week are still available, though some have expired. So for anyone who missed out on Black Friday deals, there's still an opportunity to get some of the year's best prices on many Apple devices. Note: ...
iPhone 14 Pro Rear Camera

iPhone 15 to Use 'State-of-the-Art' Image Sensor From Sony for Better Low-Light Performance

Monday November 28, 2022 11:00 am PST by
Apple's upcoming iPhone 15 models will be equipped with Sony's newest "state of the art" image sensors, according to a report from Nikkei. Compared to standard sensors, Sony's image sensor doubles the saturation signal in each pixel, allowing it to capture more light to cut down on underexposure and overexposure. Nikkei says that it is able to better photograph a person's face even with...
Apple Watch Ultra Oceanic Plus App

Apple Announces Oceanic+ App Now Available for Apple Watch Ultra

Monday November 28, 2022 6:11 am PST by
Apple today announced that the Oceanic+ app is available for the Apple Watch Ultra starting today. Designed by Huish Outdoors in collaboration with Apple, the app serves as a dive computer for recreational scuba diving at depths up to 40 meters/130 feet. Apple already offers a basic Depth app on the Apple Watch Ultra for viewing your current depth, maximum depth reached, water temperature,...
app store awards 2021

Apple Announces 2022 App Store Award Winners, Highlighting Best Apps of the Year

Tuesday November 29, 2022 3:10 am PST by
Apple today announced its 2022 App Store Award winners, highlighting the 16 best apps and games selected by Apple's global App Store editorial team. The top apps were chosen by Apple for their quality, innovative technology, creative design, positive cultural impact, and ability to deliver "exceptional experiences." Apple CEO Tim Cook said: This year's App Store Award winners reimagined...
rapid security response

Apple Releases Another Rapid Security Response Update for iOS 16.2 Beta Users

Monday November 28, 2022 10:16 am PST by
Apple today released a Rapid Security Response update that is available for those running the iOS 16.2 beta, marking the launch of the second RSR update since the feature was released in iOS 16. The Rapid Security Response Update is designed to provide iOS 16.2 beta users with bug fixes without the need to install a full update. The initial RSR release for iOS 16.2 beta users was a test with ...
twitter elon musk

Elon Musk Claims Apple Has 'Mostly Stopped' Offering Ads on Twitter and Is Making Moderation Demands

Monday November 28, 2022 10:42 am PST by
Apple has cut back on its Twitter advertising, according to Twitter CEO Elon Musk. In a tweet, Musk said that Apple has "mostly stopped" its Twitter ads, asking if Apple hates "free speech." Musk went on to publish a poll asking if Apple should "publish all censorship actions" taken that impact customers and he began retweeting content from companies that Apple has had moderation discussions ...
iphone 11 tesla cybertruck close up

Elon Musk Pledges to Build iPhone Rival If Apple Ousts Twitter

Tuesday November 29, 2022 2:48 am PST by
Elon Musk has pledged to offer an "alternative phone" if Apple and Google remove Twitter from their app stores, adding to long-standing rumors about an iPhone rival from Tesla. Modified iPhone 11 Pro in the style of the Tesla Cybertruck, by Caviar. Musk's remark came after being asked about the potential scenario of Twitter being removed from app stores, which could conceivably happen if the...
General Black Friday Deals 2022 Green

All the Apple Black Friday Deals You Can Still Get

Friday November 25, 2022 4:40 am PST by
Although Black Friday is now technically over, many Apple products are still seeing major discounts through the weekend as we head into Cyber Monday. In this article, you'll find every Apple device with a notable Black Friday sale that's still available. We'll be updating as prices change and new deals arrive, so be sure to keep an eye out if you don't see the sale you're looking for yet. Note:...