xrOS: What to Expect From the Software Designed for Apple's AR/VR Headset

The Worldwide Developers Conference (WWDC), Apple's annual developer and software-oriented conference, is now just a few days away. As with previous years, Apple is expected to introduce major updates to all of its operating systems, but unique to WWDC 2023, Apple is also very likely to unveil xrOS, the software that will run its much-rumored AR/VR mixed-reality headset. Here's everything we're expecting from it.

xrOS: What's in a Name?

Apple has not publicly acknowledged the existence of its headset, but internal Apple sources have confirmed that the operating system will be called xrOS, and Apple has used hidden shell companies to trademark the name in various countries.

‌xrOS‌ is meant to stand for "extended reality," hinting at the augmented and virtual reality functions at the heart of the head-mounted device. The backend capitalization also conforms to the naming conventions Apple has adopted for all of the operating systems in its ecosystem.

According to reporting by Bloomberg's Mark Gurman, Apple sees the headset as a device for gaming, watching streaming video, video conferencing, health and fitness, and interfacing with other people. Therefore ‌xrOS‌ will be focused on providing the best possible environment for delivering that content.

xros wordmarkApple-registered wordmark for "‌xrOS‌" in New Zealand

xrOS User Interface

‌xrOS‌ is believed to have an iOS-like interface that will be familiar to iPhone and iPad users, but presented to them and interacted with in an entirely new way.

We are expecting a dedicated Home Screen containing apps and customizable widgets, all of which can be rearranged, and all viewed on dual high-resolution 4K micro OLED displays with up to 3,000 pixels per inch for a rich, realistic, and immersive viewing experience.

Both of the user's hands and eyes will be tracked by more than a dozen optical cameras, and the wearer is expected to be able to look at an on-screen item to select it, and use a hand gesture like a pinch to activate the item on the screen.

googleglassaugmentedrealityThe now defunct-Google Glass: An early example of an AR interface

The ‌xrOS‌ software could even potentially project AR app interface elements onto actual objects in the real world for a mixed-reality overlay kind of effect.

Apple is also said to be working on an in-air typing feature that is expected to be a bit rudimentary at launch, with Apple to make notable improvements over time.

Apps

At the core of ‌xrOS‌ will be re-imagined versions of stock Apple apps like Safari, Photos, Messages, Maps, Apple TV+, Apple Music, Podcasts, Reminders, and Calendar, as well as a FaceTime app customized for the headset. The Maps app will also feature, and could incorporate some of Apple's Look Around and landmark functionality, allowing users to explore cities around the world.

Users will be able to work on several apps at the same time, while an ‌xrOS‌ App Store will host made-for-headset apps, as well as existing ‌App Store‌ content. Apple is also said to be adapting ‌iPad‌ apps for the headset's 3D interface.

app store awards 2022
In addition, Apple is set on transforming several existing services and apps into immersive viewing experiences. For example, users will be able to watch videos in virtual reality environments as if they were looking at a giant screen, or participate in guided meditations accompanied by immersive visuals, audio, and voiceovers.

Some of the apps and services said to offer radically different experiences in ‌xrOS‌ include Apple Fitness+, ‌Apple TV‌+ (with a focus on viewing sports content like MLB and MLS), and a 3D version of Apple's collaborative Freeform tool. As for ‌FaceTime‌, with all of the cameras that the headset is expected to have, one-on-one chats are said to feature realistic avatars which mimic the user's actual facial expressions and body movements.

Apple is also said to have created a Books app for reading in virtual reality, a Health app focusing on psychological wellness, and a Camera app that can take images from the headset's cameras.

Gaming and App Creation

To get people to purchase the mixed-reality headset, Apple will need to convince users that the software experiences are worth it. That will require not only compelling first-party experiences, but also innovative third-party apps from developers.

a screenshot of iron man vrIron Man VR on the Meta Quest headset

With gaming reportedly a focus, Apple is said to have been working with a select number of game developers to help them update their existing content for mixed reality, but Apple reportedly also has a robust set of tools available that will allow non-developers to create their own AR/VR experiences. According to one report, customers will be able to create and release AR apps for the headset using Siri as an assistant, even if they do not have the ability to code.

The report likens Apple's tool to Minecraft and Roblox, which allow anyone to easily create 3D tools and worlds. Apple is said to be utilizing technology that it acquired from Montreal-based startup Fabric Software in 2017, and customers would be able to distribute the AR apps they create on the ‌App Store‌ alongside developers.

It's worth noting that the report cites sources who last saw demonstrations of the tool in 2021, so the report is based on older information and it's possible that Apple's plans have changed at least slightly in the time that has passed since. Whether this latter report is still accurate is something we should learn soon.

When is xrOS Coming?

xrOS Text Feature Blue Triad
Apple's software tools for the headset are likely to be revealed at WWDC 2023, giving developers time to create AR and VR apps and experiences for the headset before it launches. In that sense, we won't see the full version of ‌xrOS‌ until the headset is officially released to the public, and that isn't expected to happen until later in the year.

For everything else we know about the headset, including all the hardware details, be sure to check our dedicated AR/VR headset roundup.

Related Roundup: Apple Vision Pro
Buyer's Guide: Vision Pro (Buy Now)
Related Forum: Apple Vision Pro

Top Rated Comments

Mr. Awesome Avatar
11 months ago
Can’t wait for five pages of comments about how it’s “DOA” and “nobody will buy this” when nobody has even seen the thing yet.
Score: 25 Votes (Like | Disagree)
TheYayAreaLiving ?️ Avatar
11 months ago
Does anyone thinks xrOS sounds confusing?

RealityOS sounds so much better and appealing.
Score: 17 Votes (Like | Disagree)
jz0309 Avatar
11 months ago
less than a week to go, time to ignore all rumors and just be patient ...
Score: 16 Votes (Like | Disagree)
citysnaps Avatar
11 months ago

Can’t wait for five pages of comments about how it’s “DOA” and “nobody will buy this” when nobody has even seen the thing yet.
Sadly, it happens with every new Apple product release. Seems many people intentionally keep their imaginations stunted and stored away in a box buried 10 feet below the ground, never to see the light of day.

The good news is they don't work at Apple. :)
Score: 16 Votes (Like | Disagree)
Mrkevinfinnerty Avatar
11 months ago

Can’t wait for five pages of comments about how it’s “DOA” and “nobody will buy this” when nobody has even seen the thing yet.
flops harder than a sumo wrestler going down a water slide.
Score: 14 Votes (Like | Disagree)
vegetassj4 Avatar
11 months ago
Waiting on the rumored AR Ultra



Attachment Image
Score: 13 Votes (Like | Disagree)

Popular Stories

apple tv 4k yellow bg feature

When to Expect a New Apple TV to Launch

Tuesday April 9, 2024 8:30 am PDT by
It has been nearly a year and a half since the current Apple TV was released, so the device is becoming due for a hardware upgrade. Below, we recap rumors about the next Apple TV, including potential features and launch timing. The current model is the third-generation Apple TV 4K, announced in October 2022. Key new features compared to the previous model from 2021 include a faster A15...
iPhone 16 Pro Sizes Feature

Alleged iPhone 16 Battery Details Show Smaller Capacity for One Model

Tuesday April 9, 2024 3:46 am PDT by
Apple's upcoming iPhone 16 lineup will feature bigger battery capacities compared to previous-generation models with the exception of the iPhone 16 Plus, which will have a smaller battery than its predecessor. That's according to the Chinese Weibo-based leaker OvO Baby Sauce OvO, a relatively new source of supply chain leaks with an as-yet unproven track record for accuracy. The iPhone 16 ...
iPad Mini 6 YouTubed 2

When to Expect the Next iPad Mini and Low-End iPad Models to Launch

Sunday April 7, 2024 6:45 am PDT by
While rumors have been focused on new iPad Pro and iPad Air models, some Apple customers are wondering when the next iPad mini will be released. In his Power On newsletter today, Bloomberg's Mark Gurman said new iPad mini and entry-level iPad models will be released in late 2024 at the earliest. "The company is also working on new versions of the low-end iPad and iPad mini, but those...
10th Gen iPad Feature Deals 2

Best Buy Introduces Record Low Prices Across Every 10th Gen iPad

Sunday April 7, 2024 8:01 am PDT by
Following a few notable discounts on MacBooks yesterday, Best Buy today introduced a sale on the 10th generation iPad, including numerous all-time low prices on the tablet. Prices start at $349.00 for the 64GB Wi-Fi model, and include $100 markdowns on both Wi-Fi and cellular devices. Note: MacRumors is an affiliate partner with Best Buy. When you click a link and make a purchase, we may...
Qualcomm Snapdragon X Elite Laptop

Microsoft Says Windows Laptops With Snapdragon X Elite Will Be Faster Than M3 MacBook Air

Monday April 8, 2024 10:00 am PDT by
Microsoft will advertise that its upcoming Windows laptops with Qualcomm's Snapdragon X Elite processor are faster than the MacBook Air with Apple's latest M3 chip, according to internal documents obtained by The Verge. "Microsoft is so confident in these new Qualcomm chips that it's planning a number of demos that will show how these processors will be faster than an M3 MacBook Air for CPU...
M3 iPad Feature 3

Apple Event for New iPads Still Considered 'Unlikely' Following Delays

Tuesday April 9, 2024 6:37 am PDT by
Apple is "unlikely" to hold an event to announce new iPad Pro and iPad Air models, according to sources cited by Taiwanese supply chain publication DigiTimes. Bloomberg's Mark Gurman already said Apple was not planning to hold an event for the new iPads, but he made this claim back in early March, before it was reported that the devices were postponed due to manufacturing delays. With the...
iPhone 16 Camera Lozenge 2 Colors

iPhone 16 Plus Rumored to Come in These 7 Colors

Wednesday April 10, 2024 3:52 am PDT by
Apple's iPhone 16 Plus may come in seven colors that either build upon the existing five colors in the standard iPhone 15 lineup or recast them in a new finish, based on a new rumor out of China. According to the Weibo-based leaker Fixed focus digital, Apple's upcoming larger 6.7-inch iPhone 16 Plus model will come in the following colors, compared to the colors currently available for the...