Apple's Mixed Reality Headset to Feature iOS-Like Interface, Advanced Hand Tracking, and Will Work as Second Display for Mac

The AR/VR headset that Apple has been working on for years now is set to launch in 2023, which means rumors about the device are picking up. Bloomberg today shared some information on the headset's interface, the apps it will feature, and how it will work.

apple ar headset concept 1Concept render based on purported leaked information by Ian Zelbo

Apple's mixed reality headset will have an "iOS-like" interface that will include "many functions" available on the iPhone and iPad, with the headset also able to serve as an external display for a connected Mac. Users will be able to see their Mac's display in VR, controlling the Mac with a physical keyboard and trackpad/mouse.

Using the headset will "feel familiar to Apple users," with an interface that is close to identical to the look of an ‌iPhone‌ or an ‌iPad‌. There will be a Home screen with app icons that can be rearranged, as well as customizable widgets.

Eye and hand-tracking will be a "major selling point" for the headset, with Apple using external cameras that can analyze a user's hands and eyes. According to Bloomberg, the wearer will be able to control the headset by looking at an on-screen item to select it, then using gestures to activate the on-screen item. Unlike other headset options, Apple will not rely on a physical controller.

Likely to be named "Reality Pro," the headset will be able to switch between augmented reality and virtual reality. Augmented reality will overlay virtual objects on the real world, while virtual reality is an entirely virtual environment that shuts out the wearer's surroundings. Augmented reality functions will work through a pass-through mode that will use the exterior cameras on the headset, and swapping between AR and VR will be done with a Digital Crown-like control knob.

Video conferencing will be a focus, with Apple adding FaceTime-based video chatting capabilities and meeting rooms. A user's actual face and full body will be rendered in virtual reality for interactive meetings, with the realistic avatars available for one-to-one chats. FaceTime with multiple participants will use less detailed icons like Memoji.

Apple is working on VR content with media partners like Disney and Dolby, as well as updating Apple TV+ shows and movies to work with the headset. Apple's aim is to provide viewers with the experience of looking at a giant screen in an environment like a desert or outer space.

Apps will include Safari, Photos, Mail, Messages, ‌Apple TV‌+, Apple Music, Podcasts, and Calendar, and the headset will have a dedicated App Store for third-party content. Siri will be able to be used for text input, as will an ‌iPhone‌, ‌iPad‌, or Mac keyboard. Apple is working on an air typing feature, but it is not expected to be ready for launch.

For those who wear glasses, Apple will provide custom lenses that are able to sit within the enclosure, and Apple is expecting users to wear AirPods to get an audio experience on par with the visual experience that the headset provides, though it will have built-in speakers.

As previously rumored, the headset will have an external battery pack to prevent it from overheating on a user's face due to the high-end Mac chips used for the device. The battery is approximately the size of two iPhone 14 Pro Max models stacked on top of one another, and it will power the headset for around two hours. An external battery will allow users to swap one battery and charge another to use the device for a longer period of time.

Other AR/VR rumored headset features include 4K microOLED displays, more than a dozen cameras, iris tracking, facial expression detection, and more, with details available in our roundup. The headset is expected later in 2023, perhaps as soon as the spring, and it will sell for somewhere around $3,000.

To get people interested in the headset, Apple Store locations will have a dedicated area where it can be demonstrated and tested after launch.

Popular Stories

Generic iOS 18

Apple Releases iOS 18.0.1 With Touch Screen Bug Fix and More

Thursday October 3, 2024 2:22 pm PDT by
Apple today released iOS 18.0.1 and iPadOS 18.0.1, the first updates to the iOS 18 and iPadOS 18 operating systems that debuted earlier in September. iOS 18.0.1 and iPadOS 18.0.1 come two weeks after the launch of iOS 18. The new software can be downloaded on eligible iPhones and iPads over-the-air by going to Settings > General > Software Update. According to Apple's release notes, the...
ipad mini 2021 youtube

New Report Reveals When to Expect the iPad Mini 7

Tuesday October 1, 2024 2:09 pm PDT by
Apple is working on a new iPad mini that will "potentially" be released "by the end of 2024," according to a report today from Bloomberg's Mark Gurman. Last month, Gurman reported that Apple had "new iPads in the works," including an upgraded version of the iPad mini. At the time, he said the device was "on deck for Apple's October event" alongside the first M4 Macs. The wording in his...
macOS Sequoia Night Feature

Apple Releases macOS Sequoia 15.0.1 With Bug Fixes

Thursday October 3, 2024 2:27 pm PDT by
Apple today released macOS Sequoia 15.0.1, the first update for the macOS Sequoia operating system. The 15.0.1 update comes a week after Apple first released macOS Sequoia 15. Mac users can download the ‌macOS Sequoia‌ update by using the Software Update section of System Settings. According to Apple's release notes, macOS Sequoia 15.0.1 fixes a bug that could cause the Messages app...
15 New Things Your iPhone Can Do in iOS 18

15 New Things Your iPhone Can Do in iOS 18.1

Friday September 27, 2024 6:14 am PDT by
Apple is set to release iOS 18.1 in October, bringing the first set of Apple Intelligence features to iPhone 15 Pro and iPhone 16 models. This update marks a significant step forward in Apple's AI integration, offering a new Siri contextually-aware experience and a range of additional capabilities powered by on-device machine learning and large language models. There are a couple of handy new...
maxresdefault

Two Weeks With the iPhone 16 Pro Max

Friday October 4, 2024 12:04 pm PDT by
Now that it's been two weeks since the iPhone 16 models were released, we've been able to spend enough time with the new devices to share a more in-depth review on their performance, battery life, feature set, and more. Subscribe to the MacRumors YouTube channel for more videos. We've been testing the iPhone 16 Pro and Pro Max, but the gap between the Pro models and the standard iPhone 16...
macOS Sequoia Feature

Here Are All the New Features Coming to macOS Sequoia This Month

Thursday October 3, 2024 6:27 am PDT by
‌Apple in October will release macOS Sequoia‌ 15.1, bringing to Macs the first Apple Intelligence features such as Writing Tools, new Siri features, Smart Replies, and more. In addition, macOS 15.1 adds a handful of welcome tweaks and improvements to existing Mac capabilities. Here's what we can expect from the first major update to macOS Sequoia later this month. Note that Apple...
apple silicon mac lineup wwdc 2022 feature purple

MacBook Pro, iMac, and Redesigned Mac Mini With M4 Chips on Track to Launch 'This Year'

Tuesday October 1, 2024 1:57 pm PDT by
Apple plans to release new MacBook Pro, iMac, and Mac mini models with the M4 series of chips "this year," according to Bloomberg's Mark Gurman. Gurman initially said these Macs would likely be announced during a virtual event this October, but he has been more vague about the timing lately, with wording such as "in the coming weeks" and now merely "this year." In any case, it is clear that...
tedlasso

'Ted Lasso' to Return to Apple TV+ as Season Four Allegedly 'Confirmed'

Thursday October 3, 2024 9:21 am PDT by
Ted Lasso will be returning for a fourth season, according to Sigmund Judge, a writer at MacStories and co-host of the Magic Rays of Light podcast. In a social media post today, Judge said he has confirmed that pre-production of the smash-hit Apple TV+ comedy series will begin in January in London, England. Apple has yet to confirm the fourth season, and there is no set release date yet....

Top Rated Comments

dypeterc Avatar
22 months ago
What if Apple were to be leaking AR/VR goggle rumors just to keep Meta in the AR/VR game wasting money and resources?
Score: 50 Votes (Like | Disagree)
randolorian Avatar
22 months ago
I look forward to the day that we don’t have to look at this same mock-up with every Apple VR post.
Score: 23 Votes (Like | Disagree)
TheYayAreaLiving ?️ Avatar
22 months ago
For $3000.00 including tax, It's overly expensive.

I'm not sure if this world is even ready for this Apple AR/VR headset. Siri connecting with Apple AR/VR headset??? Yeah... I don't know about this one.
Score: 21 Votes (Like | Disagree)
KaliYoni Avatar
22 months ago

the headset will be able to switch between augmented reality and virtual reality.
And we thought sidewalk iPhone users made it hard to walk around without bumping into distracted, oblivious people...
Score: 15 Votes (Like | Disagree)
DelayedGratificationGene Avatar
22 months ago
These comments are almost as funny as the ones ridiculing the iPhone rumors. Almost as funny.
Score: 12 Votes (Like | Disagree)
trvs Avatar
22 months ago
What (who) is this product for? I just don’t get it.
Score: 11 Votes (Like | Disagree)