Kuo: Apple AR Headset to Feature Advanced Hand Gesture Controls and Object Detection
Apple's long rumored AR headset is predicted to include multiple highly sensitive 3D sensing modules in order to offer an innovative hand gesture and object detecting user interface, according to Apple analyst Ming-Chi Kuo in a new research note obtained by MacRumors.
We predict that the structured light of the AR/MR headset can detect not only the position change of the user or other people’s hand and object in front of the user's eyes but also the dynamic detail change of the hand (just like the iPhone's Face ID/structured light/Animoji can detect user's dynamic expression change). Capturing the details of hand movement can provide a more intuitive and vivid human-machine UI (for example, detecting the user's hand from a clenched fist to open and the balloon [image] in hand flying away).
Kuo describes the ability for the headset to detect both hand gestures and movements to provide the user with an immersive experience where the user could open their hand to let go of a virtual balloon.
In order to accomplish this impressive feat, Apple is expected to incorporate four sets of 3D sensors which are of higher quality and specifications than the current iPhones. Kuo sees the quality of this human-machine user interface as the key to the success of Apple's upcoming AR headset. According to Kuo, these interface abilities include gesture control, object detection, as well as eye tracking, iris recognition, voice control, skin detection, expression detection, and spatial detection.
Earlier this year, Patently Apple pointed out a patent application from Apple titled "Devices, Methods, and Graphical User Interfaces for Interacting with Three-Dimensional Environments," which details this same concept.
Different movements and locations of the micro-gestures and various movement parameters are used to determine the operations that are performed in the three-dimensional environment. Using the cameras to capture the micro-gestures to interact with the three-dimensional environment allow the user to freely move about the physical environment without be encumbered by physical input equipment, which allows the user to explore the three-dimensional environment more naturally and efficiently.
Apple is widely expected to launch its first-generation AR-focused device in 2022.
Related Stories
Tuesday February 22, 2022 12:49 am PST by
Sami FathiApple's first AR/VR headset will enter mass production this fall with a launch taking place before the end of the year, according to industry sources cited today in a report from DigiTimes.
Concept render based on purported leaked information by Ian Zelbo Yesterday, DigiTimes previewed a report stating that Apple's headset has completed production tests, and now, in the full report published...
Apple's long-rumored augmented reality (AR) headset project is set to bear its first fruit late next year with the launch of the first device carrying a pair of processors to support its high-end capabilities, according to a new research report from noted analyst Ming-Chi Kuo seen by MacRumors.
According to Kuo, the higher-end main processor is said to be similar to the M1 chip Apple...
Apple's widely-rumored AR/VR headset is coming at the end of 2022, with shipments to ramp up in the first quarter of 2023, according to analyst Ming-Chi Kuo. In a research note with TF International Securities, obtained by MacRumors, Kuo said Apple's headset will feature two "3P pancake lenses," which have a folded design that allows light to reflect back and forth between the display and...
Apple has completed key production tests for its long-rumored augmented reality (AR) and virtual reality (VR) headset, according to DigiTimes.
Concept render based on purported leaked information by Ian Zelbo Citing information from the headset's component suppliers, the device has reportedly completed second-phase engineering validation tests (EVT 2) to ensure that prototype units meet...
Apple's long-rumored AR/VR headset could be delayed until 2023 after being beset with issues during the development process, according to Bloomberg.
Concept render based on purported leaked information by Ian Zelbo Citing people familiar with Apple's plans, the report claims that Apple originally planned to launch the headset in 2021 and ship it this year. The company then set its sights on...
Wednesday September 22, 2021 6:17 am PDT by
Sami FathiApple's augmented reality headset will enter mass production in the second quarter of next year, with a launch expected between the third and fourth quarter of 2022, according to a translated report from the Taiwanese version of DigiTimes.
In June, Apple analyst Ming-Chi Kuo offered a similar timeline for Apple's AR headset, reporting it will launch sometime between April and June of next...
Apple's development of its rumored augmented reality (AR) headset is beginning to mirror the period before the launch of the Apple Watch, according to Morgan Stanley analysts.
In a note to investors, seen by Investor's Business Daily, Morgan Stanley analysts explained that after years of building expertise and a number of setbacks, Apple's long-awaited AR headset is "approaching liftoff."...
Tuesday December 7, 2021 11:27 pm PST by
Sami FathiApple is already working on its second-generation AR headset, which will feature a lighter design, adopt a new battery system, and a faster processor, Apple analyst Ming-Chi Kuo said today in an investor note obtained by MacRumors.
Apple is widely expected to launch its first-generation AR-focused device in 2022. That device has been previously reported to feature a processor with Mac-level...
Popular Stories
Sunday September 25, 2022 2:27 pm PDT by
Sami FathiA YouTuber has put Apple's claims for the durability of the Apple Watch Ultra to the test by putting it up against a drop test, a jar of nails, and repeated hits with a hammer to test the sapphire crystal protecting the display.
TechRax, a channel popular for testing the durability of products, first tested the Apple Watch Ultra by dropping it from around four feet high. The Apple Watch...
Upon the release of the second-generation AirPods Pro, the AirPods Max became the oldest current-generation AirPods product still in Apple's lineup. Introducing several new features like Adaptive Transparency and the H2 chip, the second-generation AirPods Pro may provide some of the best indications yet of what to expect from the second-generation AirPods Max.
Almost two years later, rumors...
Sunday September 25, 2022 10:57 am PDT by
Sami FathiAs we approach the end of a busy product release season for Apple with only new iPads and Macs left to be announced over the next month or so, we're also setting our sights on 2023. Apple is rumored to have several major products in the pipeline for next year, including new Macs, a new HomePod, a VR/AR headset, and so much more.
Other than new iPhones and Apple Watches, which are expected...
Sunday September 25, 2022 6:50 am PDT by
Sami FathiApple may decide to release its remaining products for 2022, which include updated iPad Pro, Mac mini, and 14-inch and 16-inch MacBook Pro models, through press releases on its website rather than a digital event, according to Bloomberg's Mark Gurman. In his latest Power On newsletter, Gurman said that Apple is currently "likely to release its remaining 2022 products via press releases,...
The Apple Watch Series 8 and Apple Watch Ultra are now available to purchase, but if you aren't interested in these updates you can save a lot of money on Series 7 models right now on Amazon.
Note: MacRumors is an affiliate partner with Amazon. When you click a link and make a purchase, we may receive a small payment, which helps us keep the site running.
The best deals are on cellular...
Sunday September 25, 2022 7:02 am PDT by
Sami FathiApple is gearing up to possibly replace its "Pro Max" iPhone with an all-new "Ultra" iPhone 15 model next year, reliable Bloomberg journalist Mark Gurman said today.
Writing in his latest Power On newsletter, Gurman said that for the iPhone 15, Apple is planning a revamped design alongside USB-C and a potential name change. Apple could replace its "Pro Max" branding, which it started to use...
Friday September 23, 2022 9:40 am PDT by
Sami FathiCustomers who personalize their second-generation AirPods Pro charging case with an engraving will now have that engraving reflected directly on iOS as they pair and connect their AirPods Pro. Apple allows customers to personalize their AirPods Pro charging case with a special engraving that can include select emojis and Memojis. Unlike before, starting with the second-generation AirPods...
Monday September 26, 2022 7:34 am PDT by
Sami FathiToday marks exactly two weeks since Apple released iOS 16 to the public. Besides the personalized Lock Screen, major changes in Messages, and new features in Maps, the update has also seen its fair share of bugs, performance problems, battery drain, and more.
After major iOS updates, it's normal for some users to report having issues with the new update, but such reports usually subside in...
Apple plans to release new MacBook Pro models in the fourth quarter of 2022, according to supply chain publication DigiTimes. The report does not mention specific models, but it very likely refers to the next-generation 14-inch and 16-inch MacBook Pros given that the 13-inch model was already updated earlier this year.
There has been uncertainty surrounding the timing of new 14-inch and...
Top Rated Comments
[MEDIA=giphy]SLBr5yLzocSYw[/MEDIA]
[MEDIA=giphy]hHxTQkcjmHUTC[/MEDIA]
After having Apple AR glasses on...