Kuo: Apple AR Headset to Feature Advanced Hand Gesture Controls and Object Detection
Apple's long rumored AR headset is predicted to include multiple highly sensitive 3D sensing modules in order to offer an innovative hand gesture and object detecting user interface, according to Apple analyst Ming-Chi Kuo in a new research note obtained by MacRumors.
We predict that the structured light of the AR/MR headset can detect not only the position change of the user or other people’s hand and object in front of the user's eyes but also the dynamic detail change of the hand (just like the iPhone's Face ID/structured light/Animoji can detect user's dynamic expression change). Capturing the details of hand movement can provide a more intuitive and vivid human-machine UI (for example, detecting the user's hand from a clenched fist to open and the balloon [image] in hand flying away).
Kuo describes the ability for the headset to detect both hand gestures and movements to provide the user with an immersive experience where the user could open their hand to let go of a virtual balloon.
In order to accomplish this impressive feat, Apple is expected to incorporate four sets of 3D sensors which are of higher quality and specifications than the current iPhones. Kuo sees the quality of this human-machine user interface as the key to the success of Apple's upcoming AR headset. According to Kuo, these interface abilities include gesture control, object detection, as well as eye tracking, iris recognition, voice control, skin detection, expression detection, and spatial detection.
Earlier this year, Patently Apple pointed out a patent application from Apple titled "Devices, Methods, and Graphical User Interfaces for Interacting with Three-Dimensional Environments," which details this same concept.
Different movements and locations of the micro-gestures and various movement parameters are used to determine the operations that are performed in the three-dimensional environment. Using the cameras to capture the micro-gestures to interact with the three-dimensional environment allow the user to freely move about the physical environment without be encumbered by physical input equipment, which allows the user to explore the three-dimensional environment more naturally and efficiently.
Apple is widely expected to launch its first-generation AR-focused device in 2022.
Popular Stories
Wednesday September 24, 2025 3:58 pm PDT by
Juli CloverWith the iPhone 15 series, I did an experiment and kept my iPhone's Charge Limit set at 80 percent for an entire year. It provided an interesting look at the impact of charge limits on battery longevity, so I decided to repeat it for the iPhone 16 line.
Since September 2024, my iPhone 16 Pro Max has been limited to an 80 percent charge, with no cheating. As of today, my battery's maximum...
Apple is developing an all-new operating system codenamed "Charismatic," according to Bloomberg's Mark Gurman.
Apple smart home hub concept based on rumors
This is likely Apple's long-rumored "homeOS" operating system.
In a report last month, Gurman said both Apple's rumored smart home hub in 2026 and tabletop robot in 2027 will run the new operating system. He said the software platform ...
Apple's annual "Back to School" promotion for students ends soon, so act fast if you want to score free AirPods with the purchase of an eligible new Mac or iPad.
Until Tuesday, September 30, college students and qualifying educational staff in the U.S. can receive free AirPods 4 with Active Noise Cancellation when they purchase an eligible new Mac or iPad from Apple. This is a $179 value.
...
While the iPhone 18 Pro and iPhone 18 Pro Max are still a year away, there are already a few rumors about the devices that offer an early look ahead.
Below, we have recapped some of the early iPhone 18 Pro rumors so far. This story was published previously, and it has been updated to reflect the latest rumors.
Many early rumors prove to be true, but nothing is confirmed yet, and Apple's...
Apple is preparing to release iOS 26.0.1, according to a private account on X with a proven track record of sharing information about future iOS versions.
MacRumors has also seen evidence of iOS 26.0.1 in its visitor logs in recent days.
It is likely that iOS 26.0.1 will fix a camera-related bug on the new iPhone Air and iPhone 17 Pro models. In his iPhone Air review, CNN Underscored's...
Apple released the first beta of iOS 26.1 today, just a week after launching iOS 26. iOS 26.1 mainly adds new languages to Apple Intelligence, but there are a few other features that are worth knowing about.
New Apple Intelligence Languages
Apple Intelligence is now available in Danish, Dutch, Norwegian, Portuguese (Portugal), Swedish, Turkish, Chinese (Traditional), and Vietnamese.
AirPo...
The next Apple TV is expected to be released later this year, and a handful of new features and changes have been rumored for the device.
Below, we recap what to expect from the next Apple TV, according to rumors.
Likely Features
N1 Chip With Wi-Fi 7
Last year, Bloomberg's Mark Gurman said the next Apple TV would be equipped with Apple's own combined Wi-Fi and Bluetooth chip, which is...
In March, Apple delayed the launch of its personalized Siri features, and soon after the company was hit with multiple class action lawsuits over the situation.
The plaintiffs said they never would have purchased an iPhone 16, or would have paid less, had they known Apple's marketing about the Siri features was false.
In the U.S., all of the complaints were consolidated into one class...
