Apple Still Pursuing VR-Based Vehicle Motion Sickness Solution With Contributions From Mark Rober

Back in 2018, it was revealed that noted YouTuber and former NASA engineer Mark Rober had been quietly working in Apple's special projects group on several projects related to virtual reality.

While Rober has since left his position at Apple, the company has continued to pursue patent applications based on his team's work, and a newly published application today relates to the team's efforts to create VR-based solutions for motion sickness experienced by riders in vehicles.

Screenshot 2020 08 13 at 15
The patent, which is titled "Immersive Virtual Display" and is a continuation of a previously filed one on the same topic, shows that Apple has made some changes to the technical claims of the patent, deleting the original 20 claims and adding 20 new ones in an ongoing attempt to protect the concepts developed by the team.

Apple's patent application describes a VR system for vehicles with multiple uses. Simply, the system would provide virtual views that match visual cues with the physical motions that a passenger experiences. The VR experience would be immersive, replacing the view of the real world with a virtual environment. In addition to the obvious opportunities for entertainment, this virtual environment would be able to adjust in real time to accommodate a passenger suffering from motion sickness.

The VR system, which could involve a headset or projection onto a window or other surface, would generate virtual content for providing a view of the virtual environment. Users would be able to select a simulated route from a different location based on the route from the real environment. To do this, the system would compare the turns and curves of the route in the other location to the turns and curves of the route in the real environment, and ensure that they at least partially match.

apple vr motion sickness patent
When this is not possible, the system would augment the simulation of the selected simulated route to ensure that it matches the real-world route. The motions and accelerations of the virtual content would therefore be synchronized with the real-world motions and accelerations of the vehicle. The vehicle itself would require a sensor to be coupled to it to facilitate this.

The filing explains that the vehicle's systems and controls could also be integrated with the VR system to provide physical effects with the virtual experience. The patent makes clear that this would include control of throttle, brakes, suspension, and steering. Furthermore, the fan speed, temperature, and direction of heating and air conditioning could also be changed to provide physical effects to the virtual experience. Plans for the inclusion of sound effects via the car's audio system are also included.

Simulated environments would be stereoscopic to create an illusion of depth, and adjust in real time to provide the illusion of the user moving within the scene. All of this would allow users to feel as if they were physically in a different environment.

The patent specifically outlines how slight changes to perceived motion in the simulated environment that differ from the motions of the real world would treat and prevent motion sickness. For example, visual cues that indicate flow past a passenger may be slowed down or sped up when compared to the actual speed or acceleration of the vehicle to mitigate sickness. In addition to adapting the mapping ratio to help prevent motion sickness, visual, sensory, and audio techniques may be used to increase the comfort passengers suffering from motion sickness.

The filing also refers to a potential mixed reality application of this technology, which may potentially indicate its use in the rumored Apple Glasses product. Alternately, the patent mentions use of this VR system in autonomous vehicles, which could refer to Apple's long-rumored vehicle project.

The patent application says that windows in vehicles are "inherently unsafe and not structurally sound, and add cost to vehicles." Providing a virtual view of the real environment or of a simulated environment would eliminate the need for windows in autonomous vehicles completely. The VR system could also provide passengers with the sensation that they are riding in a larger vehicle than its actual size, which the patent says "may provide passengers with a more pleasant and secure-feeling experience when riding in a small autonomous vehicle."

Apple files dozens of patents application weekly, but patent filings are not always indicative of Apple's immediate plans. Given the complexity and outlandish nature of this filing, it is very unlikely that any of the features outlined in it will come to market any time soon. Nonetheless, it offers insight into Apple's current areas of research and development.

Related Roundups: Apple Car, Apple Glasses

Top Rated Comments

Applebot1 Avatar
28 months ago
I am ?
Score: 9 Votes (Like | Disagree)
now i see it Avatar
28 months ago
so we can all now pretend we're in a Rolls Royce.
Poverty will no longer exist. Just put on this VR headset...

The patent application says that windows in vehicles are "inherently unsafe and not structurally sound, and add cost to vehicles." Providing a virtual view of the real environment or of a simulated environment would eliminate the need for windows in autonomous vehicles completely. The VR system could also provide passengers with the sensation that they are riding in a larger vehicle than its actual size, which the patent says "may provide passengers with a more pleasant and secure-feeling experience when riding in a small autonomous vehicle."
Score: 3 Votes (Like | Disagree)
AngerDanger Avatar
28 months ago

so the key is to replace windows with screens that have a projection of real-world views?
Yeah, it's a bit like robbing a bank wearing a mask made from a photo of your own face.
Score: 3 Votes (Like | Disagree)
magicschoolbus Avatar
28 months ago
Can we focus on teleportation instead?
Score: 2 Votes (Like | Disagree)
44267547 Avatar
28 months ago
Side note:

Huge fan of Mark Rober. The Guy Is incredibly talented and shows angles to theories/experiments that take extensive testing For demonstration purposes.
Score: 1 Votes (Like | Disagree)
boswald Avatar
28 months ago

Who's interested in Apple glasses?
Sure as hell isn’t me!
Score: 1 Votes (Like | Disagree)

Popular Stories

USB C Over Lightning Feature

EU Passes Law to Switch iPhone to USB-C by End of 2024

Tuesday October 4, 2022 3:30 am PDT by
The European Parliament today voted overwhelmingly in favor of enforcing USB-C as a common charging port across a wide range of consumer electronic devices, including the iPhone and AirPods, by the end of 2024. The proposal, known as a directive, forces all consumer electronics manufacturers who sell their products in Europe to ensure that a wide range of devices feature a USB-C port. This...
ipad pro purple

Five Apple Products You Should Avoid Buying Right Now

Wednesday October 5, 2022 2:12 pm PDT by
Rumors suggest that Apple still has several new devices that are coming before the end of the year, including a range of Macs and iPads. It's not looking like we're going to get an October event in 2022, but refreshes are coming soon, probably via press release. If you're planning to buy a Mac or an iPad, make sure to check out our list to know what's safe to pick up now and what's not. iPad ...
General iOS 16 Feature Yellow

10 New iOS 16 Features Coming Later This Year

Monday October 3, 2022 2:41 pm PDT by
iOS 16 was released to the public three weeks ago with a customizable Lock Screen, the ability to edit iMessages, improvements to Focus modes, and much more. And in the coming months, iPhone and iPad users have even more new features to look forward to. We've rounded up 10 new features coming to the iPhone and iPad later this year, according to Apple. Many of the features are part of iOS...
magsafe charger orange

Apple Releases New MagSafe Charger Firmware

Tuesday October 4, 2022 12:09 pm PDT by
Apple today released updated firmware for the MagSafe Charger that is designed to work with the iPhone 12 and later and the AirPods Pro 2. The new firmware is version 10M1821, up from the prior 10M229 firmware. Note that in the Settings app, you'll see a different version number than the firmware number, with the update displayed as version 255.0.0.0 (the prior firmware was 247.0.0.0). The...
maxresdefault

Video: AirPods Pro 2 vs. Bose QuietComfort II

Monday October 3, 2022 12:50 pm PDT by
Apple on September 23 officially launched the second-generation version of the AirPods Pro, introducing updated Active Noise Cancellation, Adaptive Transparency, improved sound, and more. Right around the same time, Bose introduced new QuietComfort II earbuds with many similar features, so we thought we'd compare the two to see which has the edge. Subscribe to the MacRumors YouTube channel for ...
General iOS 16 Feature Yellow

One of iOS 16's Best Features Drains Battery When Enabled

Thursday October 6, 2022 2:15 am PDT by
One of iOS 16's most praised features comes at the cost of draining battery life, according to recently published Apple support documents. The feature, known as "keyboard haptics," is optional in iOS 16 and allows users to get physical feedback via slight vibrations upon the touch of each key, confirming that it was pressed much like keyboard sounds. The feature is a useful addition to the...
aapl logo banner

No October Apple Event Expected Despite Upcoming Wave of New Devices

Wednesday October 5, 2022 2:33 am PDT by
Apple is no longer expected to host an event this month, despite plans to unveil a host of new devices including new iPad and Mac models, according to recent reports. In recent months, Apple has been expected to hold an event in October to announce a range of products that did not receive any stage time during the company's iPhone 14 unveiling event last month. In a recent newsletter, Bloombe...
iOS 16

Apple Preparing iOS 16.0.3 With More Bug Fixes Following iPhone 14 Launch

Monday October 3, 2022 7:53 am PDT by
iOS 16.0.2 was released last month with several bug fixes for iPhone 14 issues, excessive copy and paste permission prompts, and more. Now, evidence suggests that Apple is planning to release iOS 16.0.3 with additional bug fixes. Evidence of an upcoming iOS 16.0.3 software update has shown up in MacRumors analytics logs, which have been a reliable indicator in the past. There are several...
iOS 16

Apple Seeds New Betas of iOS 16.1 and iPadOS 16.1 to Developers [Update: Public Beta Available]

Tuesday October 4, 2022 10:06 am PDT by
Apple today seeded the fourth beta of iOS 16.1 to developers for testing purposes, with the beta coming one week after the release of the third iOS 16.1 beta. The iOS 16.1 beta is also joined by the fifth beta of iPadOS 16.1, which is on a slightly different schedule as Apple started testing it prior to the launch of iOS 16. Registered developers can download the iOS 16‌ and iPadOS 16...
dynamic island outline 1

iOS 16.1 Beta Adds More Pronounced Gray Border Around Dynamic Island When Using Black Wallpapers or in Dark Mode

Tuesday October 4, 2022 11:58 am PDT by
With the latest iOS 16.1 beta, Apple has tweaked the design of the Dynamic Island on the iPhone 14 Pro and Pro Max to make it more visible on a dark background. When using a darker wallpaper or with the darker interface of Dark Mode activated, there is a light gray border around the outside of the Dynamic Island when the screen is dimmed or when the Dynamic Island is in active use. The...