Apple's Headset to Bring Continuity Features into 'Extended Reality'

Apple intends to bring new Continuity features to its upcoming mixed reality headset that will make switching between devices and virtual workspaces a seamless experience, if a new patent is anything to go by.

apple mixed reality headset concept by david lewis and marcus kane
For anyone unfamiliar with the term, Continuity is how Apple describes all the ways that the devices in its ecosystem communicate interchangeably, allowing users to switch between them without interrupting what they are doing.

Handoff for instance enables you to start working on one device, then switch to another nearby device and pick up where you left off in the same app. Other examples of Continuity features are AirPlay to Mac, Sidecar, Universal Control, and Continuity Camera.

Last week, the European Patent Office published a patent application from Apple titled "Multi-Device Continuity for use with Extended Reality (XR) Systems," in which Apple offers some examples of how it envisions how Handoff-like interoperability will work between an XR headset and other Apple devices.

continuity patent headset1

Headset wearer looks at iPhone display

In one example, Apple describes a scenario in which a headset wearer looks over at an email on an iPhone screen, whereupon a virtual replica of the Mail app's interface gets overlaid on the iPhone display. With a hand gesture or switch of gaze, the user then transfers the email to a larger virtual display suspended in their environment and continues to draft it via detection of their finger movements by the headset cameras.

In another example, while a song is playing in a media app on their iPhone, the headset user gestures or looks at a HomePod in the same room, and by doing so, transfers music playback to the smart speaker in a continuous, uninterrupted fashion, without physically approaching the speaker. "This handoff logic can be via a direct peer-to-peer connection and/or facilitated by a cloud server," note the patent authors.

continuity patent headset2

Headset draws virtual overlay of iPhone screen content

Various other scenarios are envisaged that show Apple's XR headset similarly "managing continuous transfer of control between other devices in the system responsive to three-dimensional location-based user inputs, and/or... one or more of the other devices and the device itself."

Apple also describes another implementation where, rather than switching from a physical display to a virtual one, the headset augments a desktop Mac by positioning "accessory windows" close to yet outside of the boundaries of the Mac's monitor screen into an "extended reality environment."

How far Apple will initially push Continuity with its rumored headset is unknown, but some of the examples in the patent are likely to provide a good general idea of what the company has been working towards achieving.

In terms of what we do know about the headset, it will not need an iPhone to function and will be able to be used on its own. To that end, it will run "xrOS," a new operating system designed specifically for the AR/VR experience. xrOS will include iOS apps like Safari, Photos, Messages, Maps, Apple TV+, Apple Music, Podcasts, and Calendar, as well as a FaceTime app customized for the headset.

continuity patent headset3

Headset wearer moves iPhone content to extended reality environment

There will be no wearable control device for the headset, with Apple instead relying on hand gestures that are detected by the myriad cameras on the device. Typing, for example, will be done using an "in-air" method through eye movements and hand gestures.

Apple is still planning to unveil the first version of the headset, likely called "Reality Pro," at WWDC in June this year, with the device shipping toward the end of 2023 at the earliest. For more on what to expect from the headset, we have a dedicated AR/VR roundup that aggregates all of the rumors that we've heard so far.

(Via Patently Apple.)

Related Roundup: Apple Vision Pro
Buyer's Guide: Vision Pro (Buy Now)
Related Forum: Apple Vision Pro

Top Rated Comments

usersince86 Avatar
15 months ago
This is cool technology, but to me the trend of being constantly connected in our increasingly personalized digital spaces (physical and virtual and augmented) doesn't necessarily fit well with what's best for humanity, both collectively and individually.
Score: 27 Votes (Like | Disagree)
Skyscraperfan Avatar
15 months ago
I know people who already live in an "extended reality" without an expensive headset :)
Score: 16 Votes (Like | Disagree)
TheYayAreaLiving ?️ Avatar
15 months ago
That’s pretty cool but I don’t want it to end up working like Stage Manager.
Score: 13 Votes (Like | Disagree)
citysnaps Avatar
15 months ago

This is cool technology, but to me the trend of being constantly connected in our increasingly personalized digital spaces (physical and virtual and augmented) doesn't necessarily fit well with what's best for humanity, both collectively and individually.
AR is simply a tool. And not a lifestyle.
Score: 12 Votes (Like | Disagree)
base08 Avatar
15 months ago
If this is going to work as flawlessly as the AirPods connecting "flawlessly" between Apple devices... it will be a huge fail...
Score: 12 Votes (Like | Disagree)
surfzen21 Avatar
15 months ago
Seems Apple will be the closest to a real "Ready Player One" reality compared to the other AR/VR choices.

If you only watched the movies, go and read the book. They are day and night. Although I will say Ready Player Two was tough to get through. I didn't finish it and I flew through Ready Player One.
Score: 10 Votes (Like | Disagree)

Popular Stories

iPhone 15 Pro FineWoven

Apple Reportedly Stops Production of FineWoven Accessories

Sunday April 21, 2024 6:03 am PDT by
Apple has stopped production of FineWoven accessories, according to the Apple leaker and prototype collector known as "Kosutami." In a post on X (formerly Twitter), Kosutami explained that Apple has stopped production of FineWoven accessories due to its poor durability. The company may move to another non-leather material for its premium accessories in the future. Kosutami has revealed...

Apple Announces 'Let Loose' Event on May 7 Amid Rumors of New iPads

Tuesday April 23, 2024 7:11 am PDT by
Apple has announced it will be holding a special event on Tuesday, May 7 at 7 a.m. Pacific Time (10 a.m. Eastern Time), with a live stream to be available on and on YouTube as usual. The event invitation has a tagline of "Let Loose" and shows an artistic render of an Apple Pencil, suggesting that iPads will be a focus of the event. Subscribe to the MacRumors YouTube channel for more ...
iOS 17 All New Features Thumb

iOS 17.5 Will Add These New Features to Your iPhone

Sunday April 21, 2024 3:00 am PDT by
The upcoming iOS 17.5 update for the iPhone includes only a few new user-facing features, but hidden code changes reveal some additional possibilities. Below, we have recapped everything new in the iOS 17.5 and iPadOS 17.5 beta so far. Web Distribution Starting with the second beta of iOS 17.5, eligible developers are able to distribute their iOS apps to iPhone users located in the EU...
Provenance Emulator

PlayStation and SEGA Emulator for iPhone and Apple TV Coming to App Store [Updated]

Friday April 19, 2024 8:29 am PDT by
The lead developer of the multi-emulator app Provenance has told iMore that his team is working towards releasing the app on the App Store, but he did not provide a timeframe. Provenance is a frontend for many existing emulators, and it would allow iPhone and Apple TV users to emulate games released for a wide variety of classic game consoles, including the original PlayStation, SEGA Genesis,...
Apple Vision Pro Dual Loop Band Orange Feature 2

Apple Cuts Vision Pro Shipments as Demand Falls 'Sharply Beyond Expectations'

Tuesday April 23, 2024 9:44 am PDT by
Apple has dropped the number of Vision Pro units that it plans to ship in 2024, going from an expected 700 to 800k units to just 400k to 450k units, according to Apple analyst Ming-Chi Kuo. Orders have been scaled back before the Vision Pro has launched in markets outside of the United States, which Kuo says is a sign that demand in the U.S. has "fallen sharply beyond expectations." As a...