Apple's Headset to Bring Continuity Features into 'Extended Reality'

Apple intends to bring new Continuity features to its upcoming mixed reality headset that will make switching between devices and virtual workspaces a seamless experience, if a new patent is anything to go by.

apple mixed reality headset concept by david lewis and marcus kane
For anyone unfamiliar with the term, Continuity is how Apple describes all the ways that the devices in its ecosystem communicate interchangeably, allowing users to switch between them without interrupting what they are doing.

Handoff for instance enables you to start working on one device, then switch to another nearby device and pick up where you left off in the same app. Other examples of Continuity features are AirPlay to Mac, Sidecar, Universal Control, and Continuity Camera.

Last week, the European Patent Office published a patent application from Apple titled "Multi-Device Continuity for use with Extended Reality (XR) Systems," in which Apple offers some examples of how it envisions how Handoff-like interoperability will work between an XR headset and other Apple devices.

continuity patent headset1

Headset wearer looks at iPhone display

In one example, Apple describes a scenario in which a headset wearer looks over at an email on an iPhone screen, whereupon a virtual replica of the Mail app's interface gets overlaid on the iPhone display. With a hand gesture or switch of gaze, the user then transfers the email to a larger virtual display suspended in their environment and continues to draft it via detection of their finger movements by the headset cameras.

In another example, while a song is playing in a media app on their iPhone, the headset user gestures or looks at a HomePod in the same room, and by doing so, transfers music playback to the smart speaker in a continuous, uninterrupted fashion, without physically approaching the speaker. "This handoff logic can be via a direct peer-to-peer connection and/or facilitated by a cloud server," note the patent authors.

continuity patent headset2

Headset draws virtual overlay of iPhone screen content

Various other scenarios are envisaged that show Apple's XR headset similarly "managing continuous transfer of control between other devices in the system responsive to three-dimensional location-based user inputs, and/or... one or more of the other devices and the device itself."

Apple also describes another implementation where, rather than switching from a physical display to a virtual one, the headset augments a desktop Mac by positioning "accessory windows" close to yet outside of the boundaries of the Mac's monitor screen into an "extended reality environment."

How far Apple will initially push Continuity with its rumored headset is unknown, but some of the examples in the patent are likely to provide a good general idea of what the company has been working towards achieving.

In terms of what we do know about the headset, it will not need an iPhone to function and will be able to be used on its own. To that end, it will run "xrOS," a new operating system designed specifically for the AR/VR experience. xrOS will include iOS apps like Safari, Photos, Messages, Maps, Apple TV+, Apple Music, Podcasts, and Calendar, as well as a FaceTime app customized for the headset.

continuity patent headset3

Headset wearer moves iPhone content to extended reality environment

There will be no wearable control device for the headset, with Apple instead relying on hand gestures that are detected by the myriad cameras on the device. Typing, for example, will be done using an "in-air" method through eye movements and hand gestures.

Apple is still planning to unveil the first version of the headset, likely called "Reality Pro," at WWDC in June this year, with the device shipping toward the end of 2023 at the earliest. For more on what to expect from the headset, we have a dedicated AR/VR roundup that aggregates all of the rumors that we've heard so far.

(Via Patently Apple.)

Related Roundup: Apple Vision Pro
Related Forum: Apple Vision Pro

Top Rated Comments

usersince86 Avatar
8 months ago
This is cool technology, but to me the trend of being constantly connected in our increasingly personalized digital spaces (physical and virtual and augmented) doesn't necessarily fit well with what's best for humanity, both collectively and individually.
Score: 27 Votes (Like | Disagree)
Skyscraperfan Avatar
8 months ago
I know people who already live in an "extended reality" without an expensive headset :)
Score: 16 Votes (Like | Disagree)
TheYayAreaLiving ?️ Avatar
8 months ago
That’s pretty cool but I don’t want it to end up working like Stage Manager.
Score: 13 Votes (Like | Disagree)
citysnaps Avatar
8 months ago

This is cool technology, but to me the trend of being constantly connected in our increasingly personalized digital spaces (physical and virtual and augmented) doesn't necessarily fit well with what's best for humanity, both collectively and individually.
AR is simply a tool. And not a lifestyle.
Score: 12 Votes (Like | Disagree)
base08 Avatar
8 months ago
If this is going to work as flawlessly as the AirPods connecting "flawlessly" between Apple devices... it will be a huge fail...
Score: 12 Votes (Like | Disagree)
surfzen21 Avatar
8 months ago
Seems Apple will be the closest to a real "Ready Player One" reality compared to the other AR/VR choices.

If you only watched the movies, go and read the book. They are day and night. Although I will say Ready Player Two was tough to get through. I didn't finish it and I flew through Ready Player One.
Score: 10 Votes (Like | Disagree)

Popular Stories

iphone se 4 modified flag edges

iPhone SE 4 Details: Action Button, USB-C Port, Face ID, and More

Wednesday September 27, 2023 1:34 pm PDT by
Significant changes are expected to arrive with Apple's fourth-generation iPhone SE, in terms of both design and hardware, MacRumors has learned. The iPhone SE 4, known internally under the codename Ghost, is expected to receive a new design derived almost entirely from the base model iPhone 14. According to our sources, the iPhone SE 4 will use a modified version of the iPhone 14 chassis...
Multi Display CarPlay 1

All-New Apple CarPlay Launching Later This Year With These 5 New Features

Friday September 29, 2023 11:29 am PDT by
At WWDC 2022 last year, Apple previewed the next generation of CarPlay, promising deeper integration with vehicle functions like A/C and FM radio, support for multiple displays across the dashboard, personalization options, and more. Apple said the first vehicles with support for the next-generation CarPlay experience would be announced in late 2023, but it has still not shared any additional...
iOS 17

Everything New in iOS 17.1 Beta 1

Wednesday September 27, 2023 1:57 pm PDT by
Just a week after releasing iOS 17, Apple has seeded the first beta of iOS 17.1 to developers. iOS 17.1 adds some features that Apple promised were coming to iOS 17 in the future, plus it refines and improves some existing features. This guide covers everything new in the first iOS 17.1 beta. Apple Music Favorites You can favorite songs, albums, playlists, and artists in the iOS 17.1...
iPhone 15 Pro lineup

iPhone 15 Pro Overheating Concerns Highlighted in Two More Reports

Thursday September 28, 2023 6:25 am PDT by
iPhone 15 Pro and Pro Max overheating concerns continue to make headlines this week, with the topic highlighted by The Wall Street Journal and Bloomberg. Both of the reports document anecdotal complaints from customers, and outline potential causes, but it's unclear how many devices are actually affected. Bloomberg said the overheating could be caused or compounded by the iPhone's setup...
iPhone 15 Pro lineup

Apple to Address iPhone 15 Pro Overheating Issue With iOS 17 Update

Saturday September 30, 2023 9:28 am PDT by
Apple plans to release an iOS 17 update to address a bug that may contribute to the reported iPhone 15 Pro and iPhone 15 Pro Max overheating issue, according to a statement the company shared today with MacRumors and Forbes reporter David Phelan. Apple also says some recent updates to third-party apps have overloaded the system and contributed to the overheating issue. The report notes that...
iPhone 15 USB C Port Keynote

Some USB-C Power Banks Fail to Work With iPhone 15

Thursday September 28, 2023 2:06 pm PDT by
Apple added a USB-C port to the iPhone 15 lineup this year, allowing it to work with USB-C cables, USB-C power banks, and more. It turns out that some USB-C battery packs are not working properly with Apple's iPhone 15, resulting in charging issues. As highlighted on Reddit and the MacRumors forums, not all existing USB-C power banks can be used with the iPhone 15 models, perhaps due to the...
iOS 17

Apple Releases iOS 17.0.2 and iPadOS 17.0.2 for All iPhones and iPads

Tuesday September 26, 2023 12:47 pm PDT by
Apple today released iOS 17.0.2 and iPadOS 17.0.2 updates, with the software coming five days after the releases of iOS 17.0.1 and iPadOS 17.0.1. Today's iOS 17.0.2 and iPadOS 17.0.2 updates arrive as build 21A351 and can be downloaded on eligible iPhones and iPads over-the-air by going to Settings > General > Software Update. Note that iOS 17.0.2 was previously made available for iPhone...