Apple's Mixed Reality Headset to Feature iOS-Like Interface, Advanced Hand Tracking, and Will Work as Second Display for Mac

The AR/VR headset that Apple has been working on for years now is set to launch in 2023, which means rumors about the device are picking up. Bloomberg today shared some information on the headset's interface, the apps it will feature, and how it will work.

apple ar headset concept 1Concept render based on purported leaked information by Ian Zelbo

Apple's mixed reality headset will have an "iOS-like" interface that will include "many functions" available on the iPhone and iPad, with the headset also able to serve as an external display for a connected Mac. Users will be able to see their Mac's display in VR, controlling the Mac with a physical keyboard and trackpad/mouse.

Using the headset will "feel familiar to Apple users," with an interface that is close to identical to the look of an ‌iPhone‌ or an ‌iPad‌. There will be a Home screen with app icons that can be rearranged, as well as customizable widgets.

Eye and hand-tracking will be a "major selling point" for the headset, with Apple using external cameras that can analyze a user's hands and eyes. According to Bloomberg, the wearer will be able to control the headset by looking at an on-screen item to select it, then using gestures to activate the on-screen item. Unlike other headset options, Apple will not rely on a physical controller.

Likely to be named "Reality Pro," the headset will be able to switch between augmented reality and virtual reality. Augmented reality will overlay virtual objects on the real world, while virtual reality is an entirely virtual environment that shuts out the wearer's surroundings. Augmented reality functions will work through a pass-through mode that will use the exterior cameras on the headset, and swapping between AR and VR will be done with a Digital Crown-like control knob.

Video conferencing will be a focus, with Apple adding FaceTime-based video chatting capabilities and meeting rooms. A user's actual face and full body will be rendered in virtual reality for interactive meetings, with the realistic avatars available for one-to-one chats. FaceTime with multiple participants will use less detailed icons like Memoji.

Apple is working on VR content with media partners like Disney and Dolby, as well as updating Apple TV+ shows and movies to work with the headset. Apple's aim is to provide viewers with the experience of looking at a giant screen in an environment like a desert or outer space.

Apps will include Safari, Photos, Mail, Messages, ‌Apple TV‌+, Apple Music, Podcasts, and Calendar, and the headset will have a dedicated App Store for third-party content. Siri will be able to be used for text input, as will an ‌iPhone‌, ‌iPad‌, or Mac keyboard. Apple is working on an air typing feature, but it is not expected to be ready for launch.

For those who wear glasses, Apple will provide custom lenses that are able to sit within the enclosure, and Apple is expecting users to wear AirPods to get an audio experience on par with the visual experience that the headset provides, though it will have built-in speakers.

As previously rumored, the headset will have an external battery pack to prevent it from overheating on a user's face due to the high-end Mac chips used for the device. The battery is approximately the size of two ‌iPhone‌ 14 Pro Max models stacked on top of one another, and it will power the headset for around two hours. An external battery will allow users to swap one battery and charge another to use the device for a longer period of time.

Other AR/VR rumored headset features include 4K microOLED displays, more than a dozen cameras, iris tracking, facial expression detection, and more, with details available in our roundup. The headset is expected later in 2023, perhaps as soon as the spring, and it will sell for somewhere around $3,000.

To get people interested in the headset, Apple Store locations will have a dedicated area where it can be demonstrated and tested after launch.

Popular Stories

Apple CarPlay Ultra instrument cluster themes 01

Apple's 'CarPlay Ultra' Experience Now Available

Thursday May 15, 2025 5:07 am PDT by
Apple today announced that its next-generation CarPlay experience, now dubbed "CarPlay Ultra" begins rolling out today, starting with Aston Martin vehicles. Subscribe to the MacRumors YouTube channel for more videos. CarPlay Ultra is now available with new Aston Martin vehicle orders in the U.S. and Canada. It will also be available for existing models that feature the brand's next-generation ...
Apple CarPlay Ultra instrument cluster themes 01

Apple's CarPlay Ultra Is Here – Does Your iPhone Support It?

Thursday May 15, 2025 5:17 am PDT by
Apple's recently announced CarPlay Ultra promises a deeply integrated in-car experience, but not all iPhone users will be able to take advantage of the new feature. According to Apple's press release, CarPlay Ultra requires an iPhone 12 or later running iOS 18.5 or later. This means if you're using an iPhone 11, iPhone XR, or any older model, you'll need to upgrade your device to access...
CarPlay Ultra Climate Controls

Apple Says These Vehicle Brands Plan to Offer All-New CarPlay Ultra

Thursday May 15, 2025 8:13 am PDT by
Apple today announced the launch of CarPlay Ultra, the long-awaited next-generation version of its CarPlay software system for vehicles. CarPlay Ultra features deep integration with a vehicle's instrument cluster and systems, built-in Radio and Climate apps, customizable widgets, and more. The interface is tailored to each vehicle model and automaker's identity, and drivers can also adjust...
iPhone 12 Made in India

Trump Tells Tim Cook to Stop Building iPhones in India

Thursday May 15, 2025 2:21 am PDT by
President Donald Trump has asked Apple CEO Tim Cook to halt the company's manufacturing expansion in India, in a potential disruption of Apple's plan to shift iPhone production away from China. "I had a little problem with Tim Cook yesterday," Trump said during his state visit to Qatar, according to Bloomberg. "He is building all over India." "They [India] have offered us a deal where...
apple music

Apple Music Gets New Transfer Tool to Make Switching From Spotify Easier

Wednesday May 14, 2025 5:17 pm PDT by
Apple this week introduced a new feature designed to allow prospective Apple Music users to import their saved music and playlists from third-party music services to Apple Music. The feature is either in an expanded testing phase or it has started rolling out, and it is available in Australia and New Zealand according to an Apple Support document. Signs of the transfer option first surfaced...
maxresdefault

Here's the First Real-World Look at Apple's CarPlay Ultra

Thursday May 15, 2025 5:52 am PDT by
The first videos of Apple's CarPlay Ultra experience are now available, providing a never-before-seen look at the long-anticipated iPhone-linked infotainment software. British automaker Aston Martin today shared the first video of Apple's CarPlay Ultra experience in-action, followed by a detailed walk-through of the CarPlay Ultra system on Top Gear's YouTube channel, which provides the...
iOS 18

Apple Releases iOS 18.5 With New Wallpaper, Screen Time Changes, Carrier Satellite Support for iPhone 13 and More

Monday May 12, 2025 10:06 am PDT by
Apple today released iOS 18.5 and iPadOS 18.5, the fifth updates to the iOS 18 and iPadOS 18 operating systems that came out last September. iOS 18.5 and iPadOS 18.5 come a little over a month after Apple released iOS 18.4 and iPadOS 18.4. The new software can be downloaded on eligible iPhones and iPads over-the-air by going to Settings > General > Software Update. The iOS 18.5 update has a...
fortnite apple logo 2

Epic Resubmits Fortnite to U.S. App Store After Not Hearing From Apple for 120+ Hours

Wednesday May 14, 2025 1:01 pm PDT by
On Friday, Epic Games submitted Fortnite to the U.S. App Store, and since then, we've been waiting to see if Apple would approve the game and allow it back on the iPhone and the iPad. There's been no word from Apple so far, but Epic Games opted to pull its first App Store review request, and has now resubmitted Fortnite. Fortnite leaker Shiina shared the news, with the information reposted by...

Top Rated Comments

dypeterc Avatar
30 months ago
What if Apple were to be leaking AR/VR goggle rumors just to keep Meta in the AR/VR game wasting money and resources?
Score: 50 Votes (Like | Disagree)
randolorian Avatar
30 months ago
I look forward to the day that we don’t have to look at this same mock-up with every Apple VR post.
Score: 23 Votes (Like | Disagree)
TheYayAreaLiving ?️ Avatar
30 months ago
For $3000.00 including tax, It's overly expensive.

I'm not sure if this world is even ready for this Apple AR/VR headset. Siri connecting with Apple AR/VR headset??? Yeah... I don't know about this one.
Score: 21 Votes (Like | Disagree)
KaliYoni Avatar
30 months ago

the headset will be able to switch between augmented reality and virtual reality.
And we thought sidewalk iPhone users made it hard to walk around without bumping into distracted, oblivious people...
Score: 15 Votes (Like | Disagree)
DelayedGratificationGene Avatar
30 months ago
These comments are almost as funny as the ones ridiculing the iPhone rumors. Almost as funny.
Score: 12 Votes (Like | Disagree)
trvs Avatar
30 months ago
What (who) is this product for? I just don’t get it.
Score: 11 Votes (Like | Disagree)