Kuo: Apple AR Headset to Feature Advanced Hand Gesture Controls and Object Detection
Apple's long rumored AR headset is predicted to include multiple highly sensitive 3D sensing modules in order to offer an innovative hand gesture and object detecting user interface, according to Apple analyst Ming-Chi Kuo in a new research note obtained by MacRumors.
We predict that the structured light of the AR/MR headset can detect not only the position change of the user or other people’s hand and object in front of the user's eyes but also the dynamic detail change of the hand (just like the iPhone's Face ID/structured light/Animoji can detect user's dynamic expression change). Capturing the details of hand movement can provide a more intuitive and vivid human-machine UI (for example, detecting the user's hand from a clenched fist to open and the balloon [image] in hand flying away).
Kuo describes the ability for the headset to detect both hand gestures and movements to provide the user with an immersive experience where the user could open their hand to let go of a virtual balloon.
In order to accomplish this impressive feat, Apple is expected to incorporate four sets of 3D sensors which are of higher quality and specifications than the current iPhones. Kuo sees the quality of this human-machine user interface as the key to the success of Apple's upcoming AR headset. According to Kuo, these interface abilities include gesture control, object detection, as well as eye tracking, iris recognition, voice control, skin detection, expression detection, and spatial detection.
Earlier this year, Patently Apple pointed out a patent application from Apple titled "Devices, Methods, and Graphical User Interfaces for Interacting with Three-Dimensional Environments," which details this same concept.
Different movements and locations of the micro-gestures and various movement parameters are used to determine the operations that are performed in the three-dimensional environment. Using the cameras to capture the micro-gestures to interact with the three-dimensional environment allow the user to freely move about the physical environment without be encumbered by physical input equipment, which allows the user to explore the three-dimensional environment more naturally and efficiently.
Apple is widely expected to launch its first-generation AR-focused device in 2022.
Popular Stories
Apple is not expected to release a standard iPhone 18 model this year, according to a growing number of reports that suggest the company is planning a significant change to its long-standing annual iPhone launch cycle.
Despite the immense success of the iPhone 17 in 2025, the iPhone 18 is not expected to arrive until the spring of 2027, leaving the iPhone 17 in the lineup as the latest...
Language learning app Duolingo has apparently been using the iPhone's Live Activity feature to display ads on the Lock Screen and the Dynamic Island, which violates Apple's design guidelines.
According to multiple reports on Reddit, the Duolingo app has been displaying an ad for a "Super offer," which is Duolingo's paid subscription option.
Apple's guidelines for Live Activity state that...
Apple is planning to release a low-cost MacBook in 2026, which will apparently compete with more affordable Chromebooks and Windows PCs. Apple's most affordable Mac right now is the $999 MacBook Air, and the upcoming low-cost MacBook is expected to be cheaper. Here's what we know about the low-cost MacBook so far.
Size
Rumors suggest the low-cost MacBook will have a display that's around 13 ...
Govee today introduced three new HomeKit-compatible lighting products, including the Govee Floor Lamp 3, the Govee Ceiling Light Ultra, and the Govee Sky Ceiling Light.
The Govee Floor Lamp 3 is the successor to the Floor Lamp 2, and it offers Matter integration with the option to connect to HomeKit. The Floor Lamp 3 offers an upgraded LuminBlend+ lighting system that can reproduce 281...
Belkin today announced a range of new charging and connectivity accessories at CES 2026, expanding its portfolio of products aimed at Apple device users.
UltraCharge Pro Power Bank 10K with Magnetic Ring
The lineup includes new Qi2 and Qi2.2 wireless chargers, magnetic power banks, a high-capacity laptop battery, and USB-C productivity accessories, with an emphasis on higher charging...
Now that the calendar has flipped over into January, steep discounts on popular Apple products have become more rare after the holidays. However, if you didn't get a new pair of AirPods recently and are looking for a model on sale, Amazon does have a few solid second-best prices this week.
Note: MacRumors is an affiliate partner with some of these vendors. When you click a link and make a...
Apple plans to introduce a 12.9-inch MacBook in spring 2026, according to TrendForce.
In a press release this week, the Taiwanese research firm said this MacBook will be aimed at the entry-level to mid-range market, with "competitive pricing."
TrendForce did not share any further details about this MacBook, but the information that it shared lines up with several rumors about a more...
The company behind the BlackBerry-like Clicks Keyboard accessory for the iPhone today unveiled a new Android 16 smartphone called the Clicks Communicator.
The purpose-built device is designed to be used as a second phone alongside your iPhone, with the intended focus being communication over content consumption. It runs a custom Android launcher that offers a curated selection of messaging...
