Apple Still Pursuing VR-Based Vehicle Motion Sickness Solution With Contributions From Mark Rober

Back in 2018, it was revealed that noted YouTuber and former NASA engineer Mark Rober had been quietly working in Apple's special projects group on several projects related to virtual reality.

While Rober has since left his position at Apple, the company has continued to pursue patent applications based on his team's work, and a newly published application today relates to the team's efforts to create VR-based solutions for motion sickness experienced by riders in vehicles.

Screenshot 2020 08 13 at 15
The patent, which is titled "Immersive Virtual Display" and is a continuation of a previously filed one on the same topic, shows that Apple has made some changes to the technical claims of the patent, deleting the original 20 claims and adding 20 new ones in an ongoing attempt to protect the concepts developed by the team.

Apple's patent application describes a VR system for vehicles with multiple uses. Simply, the system would provide virtual views that match visual cues with the physical motions that a passenger experiences. The VR experience would be immersive, replacing the view of the real world with a virtual environment. In addition to the obvious opportunities for entertainment, this virtual environment would be able to adjust in real time to accommodate a passenger suffering from motion sickness.

The VR system, which could involve a headset or projection onto a window or other surface, would generate virtual content for providing a view of the virtual environment. Users would be able to select a simulated route from a different location based on the route from the real environment. To do this, the system would compare the turns and curves of the route in the other location to the turns and curves of the route in the real environment, and ensure that they at least partially match.

apple vr motion sickness patent
When this is not possible, the system would augment the simulation of the selected simulated route to ensure that it matches the real-world route. The motions and accelerations of the virtual content would therefore be synchronized with the real-world motions and accelerations of the vehicle. The vehicle itself would require a sensor to be coupled to it to facilitate this.

The filing explains that the vehicle's systems and controls could also be integrated with the VR system to provide physical effects with the virtual experience. The patent makes clear that this would include control of throttle, brakes, suspension, and steering. Furthermore, the fan speed, temperature, and direction of heating and air conditioning could also be changed to provide physical effects to the virtual experience. Plans for the inclusion of sound effects via the car's audio system are also included.

Simulated environments would be stereoscopic to create an illusion of depth, and adjust in real time to provide the illusion of the user moving within the scene. All of this would allow users to feel as if they were physically in a different environment.

The patent specifically outlines how slight changes to perceived motion in the simulated environment that differ from the motions of the real world would treat and prevent motion sickness. For example, visual cues that indicate flow past a passenger may be slowed down or sped up when compared to the actual speed or acceleration of the vehicle to mitigate sickness. In addition to adapting the mapping ratio to help prevent motion sickness, visual, sensory, and audio techniques may be used to increase the comfort passengers suffering from motion sickness.

The filing also refers to a potential mixed reality application of this technology, which may potentially indicate its use in the rumored Apple Glasses product. Alternately, the patent mentions use of this VR system in autonomous vehicles, which could refer to Apple's long-rumored vehicle project.

The patent application says that windows in vehicles are "inherently unsafe and not structurally sound, and add cost to vehicles." Providing a virtual view of the real environment or of a simulated environment would eliminate the need for windows in autonomous vehicles completely. The VR system could also provide passengers with the sensation that they are riding in a larger vehicle than its actual size, which the patent says "may provide passengers with a more pleasant and secure-feeling experience when riding in a small autonomous vehicle."

Apple files dozens of patents application weekly, but patent filings are not always indicative of Apple's immediate plans. Given the complexity and outlandish nature of this filing, it is very unlikely that any of the features outlined in it will come to market any time soon. Nonetheless, it offers insight into Apple's current areas of research and development.

Related Roundups: Apple Car, Apple Glasses

Top Rated Comments

Applebot1 Avatar
17 months ago
I am ?
Score: 9 Votes (Like | Disagree)
now i see it Avatar
17 months ago
so we can all now pretend we're in a Rolls Royce.
Poverty will no longer exist. Just put on this VR headset...

The patent application says that windows in vehicles are "inherently unsafe and not structurally sound, and add cost to vehicles." Providing a virtual view of the real environment or of a simulated environment would eliminate the need for windows in autonomous vehicles completely. The VR system could also provide passengers with the sensation that they are riding in a larger vehicle than its actual size, which the patent says "may provide passengers with a more pleasant and secure-feeling experience when riding in a small autonomous vehicle."
Score: 3 Votes (Like | Disagree)
AngerDanger Avatar
17 months ago

so the key is to replace windows with screens that have a projection of real-world views?
Yeah, it's a bit like robbing a bank wearing a mask made from a photo of your own face.
Score: 3 Votes (Like | Disagree)
magicschoolbus Avatar
17 months ago
Can we focus on teleportation instead?
Score: 2 Votes (Like | Disagree)
Relentless Power Avatar
17 months ago
Side note:

Huge fan of Mark Rober. The Guy Is incredibly talented and shows angles to theories/experiments that take extensive testing For demonstration purposes.
Score: 1 Votes (Like | Disagree)
boswald Avatar
17 months ago

Who's interested in Apple glasses?
Sure as hell isn’t me!
Score: 1 Votes (Like | Disagree)

Related Stories

Mac Notebook Upgrade Program

Apple Introduces New MacBook Upgrade Program for Business Partners

Monday November 29, 2021 7:38 am PST by
In association with CIT as the financing partner, Apple has launched a new Mac Upgrade Program for small businesses and Apple business partners that allow companies to easily distribute and upgrade their fleets of MacBooks at an affordable price to all of their workers. As outlined on CIT's website, shared by Max Weinbach, Apple Business Partners can distribute the 13-inch MacBook Pro,...
General cyber monday 20 sale feature

Best Cyber Monday Deals for AirPods, Apple Pencil, iMac, More

Monday November 29, 2021 4:19 am PST by
With Black Friday over, Cyber Monday 2021 is now in full swing and you can find many of the same sales as last week on Apple products like AirPods, Apple Pencil, and iPad Pro. In this article we're focusing on the best Cyber Monday discounts on Apple products like these and more. Note: MacRumors is an affiliate partner with some of these vendors. When you click a link and make a purchase, we...
2017 apple tv

Cyber Monday: Original Apple TV 4K Drops to $99.99 for Amazon Prime Members

Monday November 29, 2021 12:01 pm PST by
We've been tracking Apple product and accessory deals for Cyber Monday 2021 today, and now Woot is offering a solid discount on the previous generation 32GB Apple TV 4K. You can get this device in new condition for just $99.99 if you're an Amazon Prime member. Note that this sale will last for one day only. Note: MacRumors is an affiliate partner with some of these vendors. When you click a...
iphone holiday

Best Black Friday iPhone Deals Still Available

Friday November 26, 2021 4:58 am PST by
Cellular carriers have always offered big savings on the newest iPhone models during the holidays, and Black Friday 2021 sales have now carried over into Cyber Monday as well. Right now we're tracking notable offers on the iPhone 13 and iPhone 13 Pro devices from AT&T, Verizon, and T-Mobile. For even more savings, keep an eye on older models like iPhone SE. Note: MacRumors is an affiliate...
General cyber monday 20 sale feature 2

Best Cyber Monday Apple Accessory Deals Available Today

Monday November 29, 2021 6:41 am PST by
We started sharing deals on Apple products for Cyber Monday 2021 earlier today, and now we're tracking deals and bargains available from all of the best Apple accessory companies. Similar to Black Friday, you can expect Cyber Monday savings from Twelve South, Nomad, Belkin, Casetify, and many more. Note: MacRumors is an affiliate partner with some of these vendors. When you click a link and...
iPhone SE Cosmopolitan Clean

New iPhone SE Reportedly on Track for Release in First Quarter of 2022

Tuesday November 30, 2021 8:08 am PST by
Apple plans to release a third-generation iPhone SE in the first quarter of 2022, according to Taiwanese research firm TrendForce. If this timeframe proves to be accurate, we can expect the device to be released by the end of March. As previously rumored, TrendForce said the new iPhone SE will remain a mid-range smartphone with added support for 5G:In terms of product development, Apple is...