Kuo: Apple AR Headset to Feature Advanced Hand Gesture Controls and Object Detection

Apple's long rumored AR headset is predicted to include multiple highly sensitive 3D sensing modules in order to offer an innovative hand gesture and object detecting user interface, according to Apple analyst Ming-Chi Kuo in a new research note obtained by MacRumors.

apple view concept right corner

Antonio De Rosa concept render

We predict that the structured light of the AR/MR headset can detect not only the position change of the user or other people’s hand and object in front of the user's eyes but also the dynamic detail change of the hand (just like the iPhone's Face ID/structured light/Animoji can detect user's dynamic expression change). Capturing the details of hand movement can provide a more intuitive and vivid human-machine UI (for example, detecting the user's hand from a clenched fist to open and the balloon [image] in hand flying away).

Kuo describes the ability for the headset to detect both hand gestures and movements to provide the user with an immersive experience where the user could open their hand to let go of a virtual balloon.

In order to accomplish this impressive feat, Apple is expected to incorporate four sets of 3D sensors which are of higher quality and specifications than the current iPhones. Kuo sees the quality of this human-machine user interface as the key to the success of Apple's upcoming AR headset. According to Kuo, these interface abilities include gesture control, object detection, as well as eye tracking, iris recognition, voice control, skin detection, expression detection, and spatial detection.

Earlier this year, Patently Apple pointed out a patent application from Apple titled "Devices, Methods, and Graphical User Interfaces for Interacting with Three-Dimensional Environments," which details this same concept.

Different movements and locations of the micro-gestures and various movement parameters are used to determine the operations that are performed in the three-dimensional environment. Using the cameras to capture the micro-gestures to interact with the three-dimensional environment allow the user to freely move about the physical environment without be encumbered by physical input equipment, which allows the user to explore the three-dimensional environment more naturally and efficiently.

Apple is widely expected to launch its first-generation AR-focused device in 2022.

Related Roundup: Apple Glasses

Top Rated Comments

arn Avatar
6 weeks ago

Sounds like iron man stuff.
I was thinking Minority Report, but maybe that just shows my age. :)

Score: 15 Votes (Like | Disagree)
TheYayAreaLiving ? Avatar
6 weeks ago

I was thinking Minority Report, but maybe that just shows my age. :)


Pretty much sums it up. At least the concept is the same.

[MEDIA=giphy]SLBr5yLzocSYw[/MEDIA]

[MEDIA=giphy]hHxTQkcjmHUTC[/MEDIA]
Score: 10 Votes (Like | Disagree)
boss.king Avatar
6 weeks ago
Did someone say advanced object recognition?



Attachment Image
Score: 8 Votes (Like | Disagree)
TheYayAreaLiving ? Avatar
6 weeks ago
Sounds like iron man stuff. True inspiration comes from this.



After having Apple AR glasses on...



Attachment Image

Attachment Image
Score: 7 Votes (Like | Disagree)
topdrawer Avatar
6 weeks ago
omg, i love making hand gestures.
Score: 5 Votes (Like | Disagree)
MayaUser Avatar
6 weeks ago

omg, i love making hand gestures.
making hand gestures in your car or on the street...the other people will love this
Score: 3 Votes (Like | Disagree)

Related Stories

apple mixed reality headset mockup feature purple

Kuo: Second-Generation Apple AR Headset to Launch in 2024 With Lighter Design, Redesigned Battery System, and More

Tuesday December 7, 2021 11:27 pm PST by
Apple is already working on its second-generation AR headset, which will feature a lighter design, adopt a new battery system, and a faster processor, Apple analyst Ming-Chi Kuo said today in an investor note obtained by MacRumors. Apple is widely expected to launch its first-generation AR-focused device in 2022. That device has been previously reported to feature a processor with Mac-level...
apple ar headset concept 2

Kuo: Apple Headset Will Use Same 96W Power Adapter as 14-Inch MacBook Pro

Monday January 10, 2022 9:07 pm PST by
Apple's rumored AR/VR headset will use the same 96W USB-C power adapter included with the higher-end 14-inch MacBook Pro, according to analyst Ming-Chi Kuo. Apple Headset render by Ian Zelbo In a research note today with TF International Securities, obtained by MacRumors, Kuo said that Apple's headset using a 96W power adapter proves that it will have Mac-level computing power, as he has...
apple mixed reality headset mockup feature purple

Kuo: Apple's Headset Coming End of 2022, Will Feature 'Pancake' Lenses

Tuesday January 4, 2022 9:29 pm PST by
Apple's widely-rumored AR/VR headset is coming at the end of 2022, with shipments to ramp up in the first quarter of 2023, according to analyst Ming-Chi Kuo. In a research note with TF International Securities, obtained by MacRumors, Kuo said Apple's headset will feature two "3P pancake lenses," which have a folded design that allows light to reflect back and forth between the display and...
apple view concept right corner

Apple Planning to Replace the iPhone With AR Headset in 10 Years

Wednesday December 1, 2021 2:29 am PST by
Apple is planning to replace the iPhone with an augmented reality (AR) headset in 10 years, a process that is apparently due to start as soon as next year with the launch of a head-mounted device, according to a recent report. Concept render of Apple's rumored AR headset by Antonio De Rosa In a note to investors seen by MacRumors, eminent analyst Ming-Chi Kuo explained that "Apple's goal is...
apple mixed reality headset mockup feature purple

Kuo: Apple AR Headset Coming in Late 2022 With Mac-Level Computing Power

Thursday November 25, 2021 8:32 pm PST by
Apple's long-rumored augmented reality (AR) headset project is set to bear its first fruit late next year with the launch of the first device carrying a pair of processors to support its high-end capabilities, according to a new research report from noted analyst Ming-Chi Kuo seen by MacRumors. According to Kuo, the higher-end main processor is said to be similar to the M1 chip Apple...
apple mixed reality headset mockup feature orange

Kuo: Mass Production on Apple's AR/VR Headset May Be Delayed Until End of 2022

Monday October 18, 2021 9:05 pm PDT by
Apple may not begin production on its upcoming AR/VR headset until the end of the fourth quarter of 2022, Apple analyst Ming-Chi Kuo said today in a note sent out to investors. That would likely result in the device launching late in 2022 or in early 2023. Before launching the headset, Apple wants to have "complete software, ecosystem, and services," which Kuo cites as the reason why Apple ...
apple ar headset concept 1

Apple AR/VR Headset Potentially Delayed Until 2023 Amid Development Problems

Friday January 14, 2022 8:10 am PST by
Apple's long-rumored AR/VR headset could be delayed until 2023 after being beset with issues during the development process, according to Bloomberg. Concept render based on purported leaked information by Ian Zelbo Citing people familiar with Apple's plans, the report claims that Apple originally planned to launch the headset in 2021 and ship it this year. The company then set its sights on...
apple mixed reality headset mockup feature yellow

Apple AR Headset 'Approaching Liftoff' as Development Mirrors Period Before Apple Watch Launch

Tuesday November 16, 2021 8:20 am PST by
Apple's development of its rumored augmented reality (AR) headset is beginning to mirror the period before the launch of the Apple Watch, according to Morgan Stanley analysts. In a note to investors, seen by Investor's Business Daily, Morgan Stanley analysts explained that after years of building expertise and a number of setbacks, Apple's long-awaited AR headset is "approaching liftoff."...

Popular Stories

iPhone 14 Mock pill and hole thumb

ProMotion Now Expected to Remain Exclusive to iPhone 14 Pro Models, Not Expand to Entire Lineup

Sunday January 16, 2022 8:56 am PST by
Continuing the tradition set with the iPhone 13 Pro, only the highest-end iPhone 14 models will feature Apple's ProMotion display technology, according to a respected display analyst. Ross Young, who on multiple occasions has detailed accurate information about Apple's future products, said in a tweet that ProMotion will not be expanded to the entire iPhone 14 lineup and will remain...
safari icon blue banner

Safari Bug Allows Websites to Track Your Recent Browsing Activity in Real Time

Sunday January 16, 2022 3:37 pm PST by
A bug in WebKit's implementation of a JavaScript API called IndexedDB can reveal your recent browsing history and even your identity, according to a blog post shared on Friday by browser fingerprinting service FingerprintJS. In a nutshell, the bug allows any website that uses IndexedDB to access the names of IndexedDB databases generated by other websites during a user's browsing session....
ipad air 4 video

New iPad Air Rumored to Launch This Spring With A15 Chip, 5G, Center Stage Camera, and More

Saturday January 15, 2022 8:05 pm PST by
Apple is planning to release a fifth-generation iPad Air with similar features as the sixth-generation iPad mini, including an A15 Bionic chip, 12-megapixel Ultra Wide front camera with Center Stage support, 5G for cellular models, and Quad-LED True Tone flash, according to Japanese blog Mac Otakara. Citing reliables sources in China, the report claims that the new iPad Air could be...
Unlikely Products 2022 Feature

Six Rumored Apple Products You're Unlikely to See This Year

Saturday January 15, 2022 2:06 pm PST by
Much has been said about what consumers could see from Apple in 2022, but the company is also working on a handful of rumored products that aren't expected to be unveiled for at least another 12 months, and in some cases a lot longer. Of course, that's assuming they get released at all. Apple works on many potential products some of which ultimately never see the light of day. With that in...
AirPods Pro Gen 3 Mock Feature Red

AirPods Pro 2 Could Start a New Accessory Ecosystem

Friday January 14, 2022 2:34 am PST by
Apple's second-generation AirPods Pro could arrive alongside a new series of accessories, recent leaked images suggest. Alleged leaked photos of the next-generation AirPods Pro obtained by MacRumors showed a charging case with a metal loop on the side for attaching a strap. Apple has not used this design for any of its other AirPod models and it is unclear why it would be added in this...
netflix2

Netflix Again Raises Prices for All Plans, 4K Streaming Now $20 Per Month

Friday January 14, 2022 12:46 pm PST by
Netflix today updated the prices for its streaming plans, and all of its offerings are now more expensive. The Basic plan is now priced at $9.99 per month, the Standard plan is priced at $15.49 per month, and the Premium plan is priced at $19.99 per month. The Basic plan is $1 more expensive, up from $8.99 per month. This plan allows users to watch on just one screen at a time, and it limits ...
tesla carplay solution

Developer Showcases Apple CarPlay Workaround for Teslas

Monday January 17, 2022 7:24 am PST by
A Tesla Model 3 owner has resorted to a workaround to implement Apple CarPlay in his vehicle, amid no sign of official support from Tesla (via Tesla North). Apple CarPlay and Apple Music support are among the most-requested Tesla features, but with no indication that Tesla is willing to implement Apple CarPlay in its vehicles, Polish developer Michał Gapiński took matters into his own...
top stories 20220115

Top Stories: iPhone 14 Pro Rumors, iCloud Private Relay Controversy, iOS 15.2.1 Released, and More

Saturday January 15, 2022 6:00 am PST by
Hole-punch? Pill? Hole-punch and pill? Rumors about what the front camera system on the iPhone 14 Pro will look like are evolving rapidly, and it now appears we might be getting a novel but potentially controversial design later this year. Other major stories this week included some confusion and controversy about iCloud Private Relay being disabled for some T-Mobile customers, increasing...