Apple's Headset to Bring Continuity Features into 'Extended Reality'

Apple intends to bring new Continuity features to its upcoming mixed reality headset that will make switching between devices and virtual workspaces a seamless experience, if a new patent is anything to go by.

apple mixed reality headset concept by david lewis and marcus kane
For anyone unfamiliar with the term, Continuity is how Apple describes all the ways that the devices in its ecosystem communicate interchangeably, allowing users to switch between them without interrupting what they are doing.

Handoff for instance enables you to start working on one device, then switch to another nearby device and pick up where you left off in the same app. Other examples of Continuity features are AirPlay to Mac, Sidecar, Universal Control, and Continuity Camera.

Last week, the European Patent Office published a patent application from Apple titled "Multi-Device Continuity for use with Extended Reality (XR) Systems," in which Apple offers some examples of how it envisions how Handoff-like interoperability will work between an XR headset and other Apple devices.

continuity patent headset1

Headset wearer looks at iPhone display

In one example, Apple describes a scenario in which a headset wearer looks over at an email on an iPhone screen, whereupon a virtual replica of the Mail app's interface gets overlaid on the iPhone display. With a hand gesture or switch of gaze, the user then transfers the email to a larger virtual display suspended in their environment and continues to draft it via detection of their finger movements by the headset cameras.

In another example, while a song is playing in a media app on their iPhone, the headset user gestures or looks at a HomePod in the same room, and by doing so, transfers music playback to the smart speaker in a continuous, uninterrupted fashion, without physically approaching the speaker. "This handoff logic can be via a direct peer-to-peer connection and/or facilitated by a cloud server," note the patent authors.

continuity patent headset2

Headset draws virtual overlay of iPhone screen content

Various other scenarios are envisaged that show Apple's XR headset similarly "managing continuous transfer of control between other devices in the system responsive to three-dimensional location-based user inputs, and/or... one or more of the other devices and the device itself."

Apple also describes another implementation where, rather than switching from a physical display to a virtual one, the headset augments a desktop Mac by positioning "accessory windows" close to yet outside of the boundaries of the Mac's monitor screen into an "extended reality environment."

How far Apple will initially push Continuity with its rumored headset is unknown, but some of the examples in the patent are likely to provide a good general idea of what the company has been working towards achieving.

In terms of what we do know about the headset, it will not need an iPhone to function and will be able to be used on its own. To that end, it will run "xrOS," a new operating system designed specifically for the AR/VR experience. xrOS will include iOS apps like Safari, Photos, Messages, Maps, Apple TV+, Apple Music, Podcasts, and Calendar, as well as a FaceTime app customized for the headset.

continuity patent headset3

Headset wearer moves iPhone content to extended reality environment

There will be no wearable control device for the headset, with Apple instead relying on hand gestures that are detected by the myriad cameras on the device. Typing, for example, will be done using an "in-air" method through eye movements and hand gestures.

Apple is still planning to unveil the first version of the headset, likely called "Reality Pro," at WWDC in June this year, with the device shipping toward the end of 2023 at the earliest. For more on what to expect from the headset, we have a dedicated AR/VR roundup that aggregates all of the rumors that we've heard so far.

(Via Patently Apple.)

Related Roundup: AR/VR Headset

Top Rated Comments

usersince86 Avatar
4 weeks ago
This is cool technology, but to me the trend of being constantly connected in our increasingly personalized digital spaces (physical and virtual and augmented) doesn't necessarily fit well with what's best for humanity, both collectively and individually.
Score: 27 Votes (Like | Disagree)
Skyscraperfan Avatar
4 weeks ago
I know people who already live in an "extended reality" without an expensive headset :)
Score: 16 Votes (Like | Disagree)
TheYayAreaLiving ? Avatar
4 weeks ago
That’s pretty cool but I don’t want it to end up working like Stage Manager.
Score: 13 Votes (Like | Disagree)
citysnaps Avatar
4 weeks ago

This is cool technology, but to me the trend of being constantly connected in our increasingly personalized digital spaces (physical and virtual and augmented) doesn't necessarily fit well with what's best for humanity, both collectively and individually.
AR is simply a tool. And not a lifestyle.
Score: 12 Votes (Like | Disagree)
base08 Avatar
4 weeks ago
If this is going to work as flawlessly as the AirPods connecting "flawlessly" between Apple devices... it will be a huge fail...
Score: 12 Votes (Like | Disagree)
surfzen21 Avatar
4 weeks ago
Seems Apple will be the closest to a real "Ready Player One" reality compared to the other AR/VR choices.

If you only watched the movies, go and read the book. They are day and night. Although I will say Ready Player Two was tough to get through. I didn't finish it and I flew through Ready Player One.
Score: 10 Votes (Like | Disagree)

Popular Stories

iOS 17 on Phone Feature

Gurman: iOS 17 to Provide Several 'Most Requested Features'

Sunday March 26, 2023 6:05 am PDT by
Apple changed the strategy for iOS 17 later in its development process to add several new features, suggesting that the update may be more significant than previously thought, Bloomberg's Mark Gurman reports. In January, Gurman said that iOS 17 could be a less significant update than iPhone updates in previous years due to the company's intense focus on its long-awaited mixed-reality...
iOS 16

iOS 16.4 Will Add These 8 New Features to Your iPhone

Sunday March 26, 2023 8:06 am PDT by
Following nearly six weeks of beta testing, iOS 16.4 is expected to be released to the public as soon as this week. The software update includes a handful of new features and changes for the iPhone 8 and newer. To install an iOS update, open the Settings app on the iPhone, tap General → Software Update, and follow the on-screen instructions. Below, we have recapped eight new features and...
apple mixed reality headset concept by david lewis and marcus kane

Some Apple Employees Seriously Concerned About Mixed-Reality Headset as Announcement Draws Closer

Sunday March 26, 2023 8:25 am PDT by
Some Apple employees are concerned about the usefulness and price point of the company's upcoming mixed-reality headset, The New York Times reports. Apple headset concept by David Lewis and Marcus Kane Initial enthusiasm around the device at the company has apparently become skepticism, according to eight current and former Apple employees speaking to The New York Times. The change of tone...
iOS 16

Apple Releases iOS 16.4 With New Emoji, Safari Web Push Notifications, Beta Changes, Voice Isolation for Calls and More

Monday March 27, 2023 10:03 am PDT by
Apple today released iOS 16.4, the fourth major update to the iOS 16 operating system that initially came out last September. iOS 16.4 comes two months after the launch of iOS 16.3, an update that added Security Keys for Apple ID. iOS 16‌.4 and iPadOS 16.4 can be downloaded on eligible iPhones and iPads over-the-air by going to Settings > General > Software Update. It can take a few minutes...
Steve Jobs Theater dusk

Apple Reportedly Demoed Mixed-Reality Headset to Executives in the Steve Jobs Theater Last Week

Sunday March 26, 2023 5:53 am PDT by
Apple showcased its mixed-reality headset to the company's top 100 executives in the Steve Jobs Theater last week, according to Bloomberg's Mark Gurman. In the latest edition of his "Power On" newsletter, Gurman explained that the "momentous gathering" is a "key milestone" ahead of the headset's public announcement planned for June. The event was intended to rally Apple's top members of...
top stories 25mar2023

Top Stories: iPhone 15 Pro Design Leak, iOS 16.4 Coming Soon, and More

Saturday March 25, 2023 6:00 am PDT by
We're still almost six months away from the official unveiling of the iPhone 15 lineup, but it seems like every day we're learning more about what to expect from the next-generation models. Notably, this week gave us our clearest look yet at what appear to be some changes for the volume and mute control hardware. iOS 16.4 and associated releases are also right around the corner with some new ...
apple tv 4k red image

Apple Releases tvOS 16.4 for Apple TV 4K and Apple TV HD

Monday March 27, 2023 10:00 am PDT by
Apple today released tvOS 16.4, the fourth major point update to the tvOS 16 operating system that came out last September. Available for the Apple TV 4K and Apple TV HD, tvOS 16.4 comes two months following the release of tvOS 16.3. The tvOS 16.4 update can be downloaded over the air through the Settings app on the ‌‌‌‌Apple TV‌‌‌‌ by going to System > Software Update....