10 Cutting Edge Features to Expect From Apple's Upcoming AR/VR Headset

Apple next year is planning to enter a new product category, launching its first mixed reality headset. Rumors indicate that the upcoming headset will support both AR and VR technology, and that it will have features that will outshine competing products.

apple ar headset concept 2

Render created by Ian Zelbo based on rumored information

With the iPhone, iPad, and Apple Watch, Apple's hardware and software led it to dominate those categories within a few short years after entering a new market, and it's likely the same thing will happen with augmented and virtual reality. We've rounded up 10 features rumored for the AR/VR headset that will set it apart from competitors.

4K Micro-OLED Displays

Apple is using two high-resolution 4K micro-OLED displays from Sony that are said to have up to 3,000 pixels per inch. Comparatively, Meta's new top of the line Quest Pro has LCD displays, so Apple is going to be offering much more advanced display technology.

Micro-OLED displays are built directly onto chip wafers rather than a glass substrate, allowing for a thinner, smaller, and lighter display that's also more power efficient compared to LCDs and other alternatives.

Apple's design will block out peripheral light, and display quality will be adjusted for peripheral vision to cut down on the processing power necessary to run the device. Apple will be able to reduce graphical fidelity at the peripherals of the headset through the eye tracking functionality being implemented.

More Than a Dozen Cameras

Apple is outfitting its AR/VR headset with more than a dozen cameras, which will capture motion to translate real world movement to virtual movement. It is said to have two downward-facing cameras to capture leg movement specifically, which will be a unique feature that will allow for more accurate motion tracking.

The cameras will be able to map the environment, detecting surfaces, edges, and dimensions in rooms with accuracy, as well as people and other objects. The cameras may also be able to do things like enhance small type, and they'll be able to track body movements.

Iris Scanning

For privacy and security, the AR/VR headset will integrate an iris scanner that can read the pattern of the user's eye, allowing for an iris scan to be used in lieu of a password and for payment authentication.

Iris scanning on the AR/VR headset will be akin to Face ID and Touch ID on the ‌iPhone‌, ‌iPad‌, and Mac. It could allow two people to use the same headset, and it is a feature that is not available on competing headsets like Meta's new Quest Pro.

Facial Expression Tracking

The cameras in the AR/VR headset will be able to interpret facial expressions, translating them to virtual avatars. So if you smile or scowl in real life, your virtual avatar will make the same expression in various apps, similar to how the TrueDepth camera system works with Memoji and Animoji on the ‌iPhone‌ and ‌iPad‌.

Thin and Light Design

Apple is aiming for comfort, and the AR/VR headset is rumored to be made from mesh fabric and aluminum, making it much lighter and thinner than other mixed reality headsets that are available on the market. Apple wants the weight to be around 200 grams, which is much lighter than the 722 gram Quest Pro from Meta.

In March 2021, Apple analyst Ming-Chi Kuo said current prototypes were around 200 to 300 grams.

Control Methods

3D sensing modules will detect hand gestures for control purposes, and there will be skin detection. Apple will allow for voice control and the AR/VR headset will support Siri like other Apple devices. Apple has tested a thimble-like device worn on the finger, but it is not yet clear what kind of input methods we'll get with the new device.

Interchangeable Headbands

The mesh fabric behind the eyepieces will make the headset comfortable to wear, and it will have swappable Apple Watch-like headbands to choose from.

One headband is rumored to provide spatial audio like technology for a surround sound-like experience, while another provides extra battery life. It's not clear if these will make it to launch, but headbands with different capabilities are definitely a possibility.

Unique App Experiences

The headset is going to run a new operating system called rOS, aka "Reality OS." Apple is designing unique apps made specifically for a virtual reality experience. Apple is said to be planning for a VR FaceTime-like experience with Animoji, where you might see a 3D Animoji or Memoji character version of a person instead of the person itself.

The aforementioned facial expression detection would allow the headset to read facial expressions and features, matching that in real time for a lifelike chatting experience. Apple is working with media partners for content that can be watched in VR, and existing services like Apple TV+ and Apple Arcade are expected to integrate with the headset.

A recent rumor of unknown reliability has indicated that Apple is working on a new version of the Messages app that could feature a new home view and chat rooms specifically for virtual and augmented reality chat features.

Apple Silicon Chip

Rumors suggest that Apple is going to use two Mac-level M2 processors for the AR/VR headset, which will give it more built-in compute power than competing products. Apple will use a high-end main processor and a lower-end processor that will manage the various sensors in the device.

Independent Operation

With two Apple silicon chips inside, the headset will not need to rely on a connection to an ‌iPhone‌ or a Mac for power, and it will be able to function on its own.

Read More

For more on everything that we've heard about Apple's work on the AR/VR headset, we have a dedicated roundup that aggregates all of the rumors.

Related Roundup: Apple Vision Pro
Buyer's Guide: Vision Pro (Buy Now)
Related Forum: Apple Vision Pro

Top Rated Comments

return2sendai Avatar
19 months ago
Or you could just go for a walk in the park, kicking through the autumn leaves, hand-in-hand with a real girl.
Score: 25 Votes (Like | Disagree)
macsplusmacs Avatar
19 months ago
Very much looking forward to seeing what Apple can pull out of their (Augmented) hat for this.

I will be there on day one.
Score: 15 Votes (Like | Disagree)
TheYayAreaLiving ?️ Avatar
19 months ago
Packed with so many features. I can already tell it’s going to be very expensive. But I’m still going to purchase one right away. Not going to stop.
Score: 14 Votes (Like | Disagree)
Leon Ze Professional Avatar
19 months ago
To be honest, none of this I find compelling. Look in time my opinion may change when real life use cases are presented. But for now I'll observe from a distance.
Score: 14 Votes (Like | Disagree)
Mick-Mac Avatar
19 months ago
I wonder what Apple will charge for the matching snorkel and flippers :-)
Score: 13 Votes (Like | Disagree)
Crowbot Avatar
19 months ago

It's just unimaginative.Looks like swimming goggles!
Umm, I'm pretty sure that's the stock mockup MR has been showing for months. It's just a placekeeper.
Score: 10 Votes (Like | Disagree)

Popular Stories

reset password request iphone

Warning: Apple Users Targeted in Phishing Attack Involving Rapid Password Reset Requests

Tuesday March 26, 2024 4:34 pm PDT by
Phishing attacks taking advantage of Apple's password reset feature have become increasingly common, according to a report from KrebsOnSecurity. Multiple Apple users have been targeted in an attack that bombards them with an endless stream of notifications or multi-factor authentication (MFA) messages in an attempt to cause panic so they'll respond favorably to social engineering. An...
iPhone Home Screen Gradient Blank Spaces 1

Sources: iOS 18 Lets Apps Be Placed Anywhere on Home Screen Grid

Sunday March 24, 2024 1:33 pm PDT by
iOS 18 will give iPhone users greater control over Home Screen app icon arrangement, according to sources familiar with the matter. While app icons will likely remain locked to an invisible grid system on the Home Screen, to ensure there is some uniformity, our sources say that users will be able to arrange icons more freely on iOS 18. For example, we expect that the update will introduce...
maxresdefault

Apple Announces WWDC 2024 Event for June 10 to 14

Tuesday March 26, 2024 10:02 am PDT by
Apple today announced that its 35th annual Worldwide Developers Conference is set to take place from Monday, June 10 to Friday, June 14. As with WWDC events since 2020, WWDC 2024 will be an online event that is open to all developers at no cost. Subscribe to the MacRumors YouTube channel for more videos. WWDC 2024 will include online sessions and labs so that developers can learn about new...
iPad Pro 2024 Landscape Camera Feature

New iPad Pro Again Rumored to Feature Landscape Front-Facing Camera

Monday March 25, 2024 5:43 am PDT by
The next-generation iPad Pro will feature a landscape-oriented front-facing camera for the first time, according to the Apple leaker known as "Instant Digital." Instant Digital reiterated the design change earlier today on Weibo with a simple accompanying 2D image. The post reveals that the entire TrueDepth camera array will move to the right side of the device, while the microphone will...
apple maps 3d feature

Apple Maps May Gain Custom Routes With iOS 18

Tuesday March 26, 2024 3:10 pm PDT by
Apple may be planning to add support for "custom routes" in Apple Maps in iOS 18, according to code reviewed by MacRumors. Apple Maps does not currently offer a way to input self-selected routes, with Maps users limited to Apple's pre-selected options, but that may change in iOS 18. Apple has pushed an iOS 18 file to its maps backend labeled "CustomRouteCreation." While not much is revealed...
sonoma desktop wwdc

Apple Releases macOS Sonoma 14.4.1 With Fix for USB Hub Bug

Monday March 25, 2024 10:10 am PDT by
Apple today released macOS Sonoma 14.4.1, a minor update for the macOS Sonoma operating system that launched last September. macOS Sonoma 14.4.1 comes three weeks after macOS Sonoma 14.4. The ‌‌‌‌macOS Sonoma‌‌ 14.4‌.1 update can be downloaded for free on all eligible Macs using the Software Update section of System Settings. There's also a macOS 13.6.6 release for those who...
Generic iOS 18 Feature Purple

iOS 18 Will Finally Bring This Android Feature to iPhone

Monday March 25, 2024 6:42 am PDT by
iOS 18 will allow iPhone users to place app icons anywhere on the Home Screen grid, according to sources familiar with development of the software update. This basic feature has long been available on Android smartphones. While app icons will likely remain locked to an invisible grid system on the Home Screen, our sources said that users will be able to arrange icons more freely on iOS 18....
Generic iOS 18 Feature Purple

iOS 18: What to Expect From 'Biggest' Update in iPhone's History

Wednesday March 27, 2024 11:10 am PDT by
At least some Apple software engineers continue to believe that iOS 18 will be the "biggest" update in the iPhone's history, according to Bloomberg's Mark Gurman. Below, we recap rumored features and changes for the iPhone. "The iOS 18 update is expected to be the most ambitious overhaul of the iPhone's software in its history, according to people working on the upgrade," wrote Gurman, in a r...