xrOS: What to Expect From the Software Designed for Apple's AR/VR Headset

The Worldwide Developers Conference (WWDC), Apple's annual developer and software-oriented conference, is now just a few days away. As with previous years, Apple is expected to introduce major updates to all of its operating systems, but unique to WWDC 2023, Apple is also very likely to unveil xrOS, the software that will run its much-rumored AR/VR mixed-reality headset. Here's everything we're expecting from it.

xrOS: What's in a Name?

Apple has not publicly acknowledged the existence of its headset, but internal Apple sources have confirmed that the operating system will be called xrOS, and Apple has used hidden shell companies to trademark the name in various countries.

‌xrOS‌ is meant to stand for "extended reality," hinting at the augmented and virtual reality functions at the heart of the head-mounted device. The backend capitalization also conforms to the naming conventions Apple has adopted for all of the operating systems in its ecosystem.

According to reporting by Bloomberg's Mark Gurman, Apple sees the headset as a device for gaming, watching streaming video, video conferencing, health and fitness, and interfacing with other people. Therefore ‌xrOS‌ will be focused on providing the best possible environment for delivering that content.

xros wordmarkApple-registered wordmark for "‌xrOS‌" in New Zealand

xrOS User Interface

‌xrOS‌ is believed to have an iOS-like interface that will be familiar to iPhone and iPad users, but presented to them and interacted with in an entirely new way.

We are expecting a dedicated Home Screen containing apps and customizable widgets, all of which can be rearranged, and all viewed on dual high-resolution 4K micro OLED displays with up to 3,000 pixels per inch for a rich, realistic, and immersive viewing experience.

Both of the user's hands and eyes will be tracked by more than a dozen optical cameras, and the wearer is expected to be able to look at an on-screen item to select it, and use a hand gesture like a pinch to activate the item on the screen.

googleglassaugmentedrealityThe now defunct-Google Glass: An early example of an AR interface

The ‌xrOS‌ software could even potentially project AR app interface elements onto actual objects in the real world for a mixed-reality overlay kind of effect.

Apple is also said to be working on an in-air typing feature that is expected to be a bit rudimentary at launch, with Apple to make notable improvements over time.

Apps

At the core of ‌xrOS‌ will be re-imagined versions of stock Apple apps like Safari, Photos, Messages, Maps, Apple TV+, Apple Music, Podcasts, Reminders, and Calendar, as well as a FaceTime app customized for the headset. The Maps app will also feature, and could incorporate some of Apple's Look Around and landmark functionality, allowing users to explore cities around the world.

Users will be able to work on several apps at the same time, while an ‌xrOS‌ App Store will host made-for-headset apps, as well as existing ‌App Store‌ content. Apple is also said to be adapting ‌iPad‌ apps for the headset's 3D interface.

app store awards 2022
In addition, Apple is set on transforming several existing services and apps into immersive viewing experiences. For example, users will be able to watch videos in virtual reality environments as if they were looking at a giant screen, or participate in guided meditations accompanied by immersive visuals, audio, and voiceovers.

Some of the apps and services said to offer radically different experiences in ‌xrOS‌ include Apple Fitness+, ‌Apple TV‌+ (with a focus on viewing sports content like MLB and MLS), and a 3D version of Apple's collaborative Freeform tool. As for ‌FaceTime‌, with all of the cameras that the headset is expected to have, one-on-one chats are said to feature realistic avatars which mimic the user's actual facial expressions and body movements.

Apple is also said to have created a Books app for reading in virtual reality, a Health app focusing on psychological wellness, and a Camera app that can take images from the headset's cameras.

Gaming and App Creation

To get people to purchase the mixed-reality headset, Apple will need to convince users that the software experiences are worth it. That will require not only compelling first-party experiences, but also innovative third-party apps from developers.

a screenshot of iron man vrIron Man VR on the Meta Quest headset

With gaming reportedly a focus, Apple is said to have been working with a select number of game developers to help them update their existing content for mixed reality, but Apple reportedly also has a robust set of tools available that will allow non-developers to create their own AR/VR experiences. According to one report, customers will be able to create and release AR apps for the headset using Siri as an assistant, even if they do not have the ability to code.

The report likens Apple's tool to Minecraft and Roblox, which allow anyone to easily create 3D tools and worlds. Apple is said to be utilizing technology that it acquired from Montreal-based startup Fabric Software in 2017, and customers would be able to distribute the AR apps they create on the ‌App Store‌ alongside developers.

It's worth noting that the report cites sources who last saw demonstrations of the tool in 2021, so the report is based on older information and it's possible that Apple's plans have changed at least slightly in the time that has passed since. Whether this latter report is still accurate is something we should learn soon.

When is xrOS Coming?

xrOS Text Feature Blue Triad
Apple's software tools for the headset are likely to be revealed at WWDC 2023, giving developers time to create AR and VR apps and experiences for the headset before it launches. In that sense, we won't see the full version of ‌xrOS‌ until the headset is officially released to the public, and that isn't expected to happen until later in the year.

For everything else we know about the headset, including all the hardware details, be sure to check our dedicated AR/VR headset roundup.

Related Roundup: Apple Vision Pro
Buyer's Guide: Vision Pro (Neutral)
Related Forum: Apple Vision Pro

Popular Stories

Apple CarPlay Ultra instrument cluster themes 01

Apple's 'CarPlay Ultra' Experience Now Available

Thursday May 15, 2025 5:07 am PDT by
Apple today announced that its next-generation CarPlay experience, now dubbed "CarPlay Ultra" begins rolling out today, starting with Aston Martin vehicles. Subscribe to the MacRumors YouTube channel for more videos. CarPlay Ultra is now available with new Aston Martin vehicle orders in the U.S. and Canada. It will also be available for existing models that feature the brand's next-generation ...
Apple CarPlay Ultra instrument cluster themes 01

Apple's CarPlay Ultra Is Here – Does Your iPhone Support It?

Thursday May 15, 2025 5:17 am PDT by
Apple's recently announced CarPlay Ultra promises a deeply integrated in-car experience, but not all iPhone users will be able to take advantage of the new feature. According to Apple's press release, CarPlay Ultra requires an iPhone 12 or later running iOS 18.5 or later. This means if you're using an iPhone 11, iPhone XR, or any older model, you'll need to upgrade your device to access...
iOS 18

Apple Releases iOS 18.5 With New Wallpaper, Screen Time Changes, Carrier Satellite Support for iPhone 13 and More

Monday May 12, 2025 10:06 am PDT by
Apple today released iOS 18.5 and iPadOS 18.5, the fifth updates to the iOS 18 and iPadOS 18 operating systems that came out last September. iOS 18.5 and iPadOS 18.5 come a little over a month after Apple released iOS 18.4 and iPadOS 18.4. The new software can be downloaded on eligible iPhones and iPads over-the-air by going to Settings > General > Software Update. The iOS 18.5 update has a...
iPhone 12 Made in India

Trump Tells Tim Cook to Stop Building iPhones in India

Thursday May 15, 2025 2:21 am PDT by
President Donald Trump has asked Apple CEO Tim Cook to halt the company's manufacturing expansion in India, in a potential disruption of Apple's plan to shift iPhone production away from China. "I had a little problem with Tim Cook yesterday," Trump said during his state visit to Qatar, according to Bloomberg. "He is building all over India." "They [India] have offered us a deal where...
CarPlay Ultra Climate Controls

Apple Says These Vehicle Brands Plan to Offer All-New CarPlay Ultra

Thursday May 15, 2025 8:13 am PDT by
Apple today announced the launch of CarPlay Ultra, the long-awaited next-generation version of its CarPlay software system for vehicles. CarPlay Ultra features deep integration with a vehicle's instrument cluster and systems, built-in Radio and Climate apps, customizable widgets, and more. The interface is tailored to each vehicle model and automaker's identity, and drivers can also adjust...
apple music

Apple Music Gets New Transfer Tool to Make Switching From Spotify Easier

Wednesday May 14, 2025 5:17 pm PDT by
Apple this week introduced a new feature designed to allow prospective Apple Music users to import their saved music and playlists from third-party music services to Apple Music. The feature is either in an expanded testing phase or it has started rolling out, and it is available in Australia and New Zealand according to an Apple Support document. Signs of the transfer option first surfaced...
maxresdefault

Here's the First Real-World Look at Apple's CarPlay Ultra

Thursday May 15, 2025 5:52 am PDT by
The first videos of Apple's CarPlay Ultra experience are now available, providing a never-before-seen look at the long-anticipated iPhone-linked infotainment software. British automaker Aston Martin today shared the first video of Apple's CarPlay Ultra experience in-action, followed by a detailed walk-through of the CarPlay Ultra system on Top Gear's YouTube channel, which provides the...

Top Rated Comments

Mr. Awesome Avatar
26 months ago
Can’t wait for five pages of comments about how it’s “DOA” and “nobody will buy this” when nobody has even seen the thing yet.
Score: 25 Votes (Like | Disagree)
TheYayAreaLiving ?️ Avatar
26 months ago
Does anyone thinks xrOS sounds confusing?

RealityOS sounds so much better and appealing.
Score: 17 Votes (Like | Disagree)
jz0309 Avatar
26 months ago
less than a week to go, time to ignore all rumors and just be patient ...
Score: 16 Votes (Like | Disagree)
citysnaps Avatar
26 months ago

Can’t wait for five pages of comments about how it’s “DOA” and “nobody will buy this” when nobody has even seen the thing yet.
Sadly, it happens with every new Apple product release. Seems many people intentionally keep their imaginations stunted and stored away in a box buried 10 feet below the ground, never to see the light of day.

The good news is they don't work at Apple. :)
Score: 16 Votes (Like | Disagree)
Mrkevinfinnerty Avatar
26 months ago

Can’t wait for five pages of comments about how it’s “DOA” and “nobody will buy this” when nobody has even seen the thing yet.
flops harder than a sumo wrestler going down a water slide.
Score: 14 Votes (Like | Disagree)
vegetassj4 Avatar
26 months ago
Waiting on the rumored AR Ultra



Attachment Image
Score: 13 Votes (Like | Disagree)