Apple Still Pursuing VR-Based Vehicle Motion Sickness Solution With Contributions From Mark Rober

Back in 2018, it was revealed that noted YouTuber and former NASA engineer Mark Rober had been quietly working in Apple's special projects group on several projects related to virtual reality.

While Rober has since left his position at Apple, the company has continued to pursue patent applications based on his team's work, and a newly published application today relates to the team's efforts to create VR-based solutions for motion sickness experienced by riders in vehicles.

Screenshot 2020 08 13 at 15
The patent, which is titled "Immersive Virtual Display" and is a continuation of a previously filed one on the same topic, shows that Apple has made some changes to the technical claims of the patent, deleting the original 20 claims and adding 20 new ones in an ongoing attempt to protect the concepts developed by the team.

Apple's patent application describes a VR system for vehicles with multiple uses. Simply, the system would provide virtual views that match visual cues with the physical motions that a passenger experiences. The VR experience would be immersive, replacing the view of the real world with a virtual environment. In addition to the obvious opportunities for entertainment, this virtual environment would be able to adjust in real time to accommodate a passenger suffering from motion sickness.

The VR system, which could involve a headset or projection onto a window or other surface, would generate virtual content for providing a view of the virtual environment. Users would be able to select a simulated route from a different location based on the route from the real environment. To do this, the system would compare the turns and curves of the route in the other location to the turns and curves of the route in the real environment, and ensure that they at least partially match.

apple vr motion sickness patent
When this is not possible, the system would augment the simulation of the selected simulated route to ensure that it matches the real-world route. The motions and accelerations of the virtual content would therefore be synchronized with the real-world motions and accelerations of the vehicle. The vehicle itself would require a sensor to be coupled to it to facilitate this.

The filing explains that the vehicle's systems and controls could also be integrated with the VR system to provide physical effects with the virtual experience. The patent makes clear that this would include control of throttle, brakes, suspension, and steering. Furthermore, the fan speed, temperature, and direction of heating and air conditioning could also be changed to provide physical effects to the virtual experience. Plans for the inclusion of sound effects via the car's audio system are also included.

Simulated environments would be stereoscopic to create an illusion of depth, and adjust in real time to provide the illusion of the user moving within the scene. All of this would allow users to feel as if they were physically in a different environment.

The patent specifically outlines how slight changes to perceived motion in the simulated environment that differ from the motions of the real world would treat and prevent motion sickness. For example, visual cues that indicate flow past a passenger may be slowed down or sped up when compared to the actual speed or acceleration of the vehicle to mitigate sickness. In addition to adapting the mapping ratio to help prevent motion sickness, visual, sensory, and audio techniques may be used to increase the comfort passengers suffering from motion sickness.

The filing also refers to a potential mixed reality application of this technology, which may potentially indicate its use in the rumored Apple Glasses product. Alternately, the patent mentions use of this VR system in autonomous vehicles, which could refer to Apple's long-rumored vehicle project.

The patent application says that windows in vehicles are "inherently unsafe and not structurally sound, and add cost to vehicles." Providing a virtual view of the real environment or of a simulated environment would eliminate the need for windows in autonomous vehicles completely. The VR system could also provide passengers with the sensation that they are riding in a larger vehicle than its actual size, which the patent says "may provide passengers with a more pleasant and secure-feeling experience when riding in a small autonomous vehicle."

Apple files dozens of patents application weekly, but patent filings are not always indicative of Apple's immediate plans. Given the complexity and outlandish nature of this filing, it is very unlikely that any of the features outlined in it will come to market any time soon. Nonetheless, it offers insight into Apple's current areas of research and development.

Related Roundups: Apple Car, Apple Glasses

Top Rated Comments

Applebot1 Avatar
22 weeks ago
I am ?
Score: 9 Votes (Like | Disagree)
now i see it Avatar
22 weeks ago
so we can all now pretend we're in a Rolls Royce.
Poverty will no longer exist. Just put on this VR headset...

The patent application says that windows in vehicles are "inherently unsafe and not structurally sound, and add cost to vehicles." Providing a virtual view of the real environment or of a simulated environment would eliminate the need for windows in autonomous vehicles completely. The VR system could also provide passengers with the sensation that they are riding in a larger vehicle than its actual size, which the patent says "may provide passengers with a more pleasant and secure-feeling experience when riding in a small autonomous vehicle."

Score: 3 Votes (Like | Disagree)
AngerDanger Avatar
22 weeks ago


so the key is to replace windows with screens that have a projection of real-world views?

Yeah, it's a bit like robbing a bank wearing a mask made from a photo of your own face.
Score: 3 Votes (Like | Disagree)
magicschoolbus Avatar
22 weeks ago
Can we focus on teleportation instead?
Score: 2 Votes (Like | Disagree)
Relentless Power Avatar
22 weeks ago
Side note:

Huge fan of Mark Rober. The Guy Is incredibly talented and shows angles to theories/experiments that take extensive testing For demonstration purposes.
Score: 1 Votes (Like | Disagree)
bjoswald Avatar
22 weeks ago


Who's interested in Apple glasses?

Sure as hell isn’t me!
Score: 1 Votes (Like | Disagree)

Top Stories

16inchmacbookpromain

Kuo: New MacBook Pro Models to Feature Flat-Edged Design, MagSafe, No Touch Bar and More Ports

Thursday January 14, 2021 9:32 pm PST by
Apple is working on two new MacBook Pro models that will feature significant design changes, well-respected Apple analyst Ming-Chi Kuo said today in a note to investors that was obtained by MacRumors. According to Kuo, Apple is developing two models in 14 and 16-inch size options. The new MacBook Pro machines will feature a flat-edged design, which Kuo describes as "similar to the iPhone 12" ...
iphone x camera close

iOS 14.4 Will Introduce Warning on iPhones With Non-Genuine Cameras

Thursday January 14, 2021 8:07 am PST by
In the second beta of iOS 14.4 seeded to developers and public testers this week, MacRumors contributor Steve Moser has discovered code indicating that Apple will be introducing a new warning on iPhones that have had their camera repaired or replaced with aftermarket components rather than genuine Apple components. "Unable to verify this iPhone has a genuine Apple camera," the message will...
prototype iphone 12 pro

Prototype iPhone 12 Pro Shown Off in Photos

Wednesday January 13, 2021 3:39 pm PST by
Developer Giulio Zompetti, who often shows off prototype versions of Apple devices, today highlighted a prototype version of the iPhone 12 Pro. The iPhone 12 Pro is running an operating system called SwitchBoard, a nonUI version of the iOS 14 update that Apple uses internally. We've seen SwitchBoard on prototype devices before, as Apple uses it to test new features. Zompetti's prototype...
foldable iPhone concept feature

Apple Testing In-Display Fingerprint Sensor for iPhone 13, Foldable iPhone Also in the Works

Friday January 15, 2021 1:46 pm PST by
Apple has started "early work" on an iPhone that has a foldable display, according to a new report from Bloomberg's Mark Gurman. Though testing of a foldable iPhone has begun, Apple has not committed to releasing a device that has a foldable display. Development has not yet expanded beyond a display and Apple does not have full foldable iPhone prototypes in its labs. Like foldable...
Apple TV Ray Light 2 Triad

Apple Extends Free Apple TV+ Trials Until July

Friday January 15, 2021 10:50 am PST by
Apple is once again planning to extend its free Apple TV+ trial subscriptions, this time until July. When Apple TV+ launched in November 2019, Apple offered free Apple TV+ subscriptions to those who purchased a new Apple device in or after September 2019. Those free subscriptions were set to expire in November 2020, but in October 2020, Apple announced that it was extending free trials...
macbook pro 16 inch thunderbolt

Bloomberg: Next-Generation MacBook Pro to Offer Improved Displays, Faster Charging Over MagSafe

Thursday January 14, 2021 11:36 pm PST by
Following today's report from analyst Ming-Chi Kuo outlining major changes for the next-generation MacBook Pro models coming in the third quarter of this year, Bloomberg's Mark Gurman has weighed in with his own report corroborating some of the details but seemingly differing a bit on others. First, Gurman shares more details on the return of MagSafe charging to the MacBook Pro, indicating...
Hue module dimmer switch

Philips Hue Announces New Wall Switch Module, Dimmer Switch, and Outdoor Light Bar

Thursday January 14, 2021 3:11 am PST by
Philips Hue has announced a new wireless dimmer switch module that lets Hue bridge owners directly control the smart lighting from their standard wall switches. The new Philips Hue wall switch module is the ideal addition to any Philips Hue set up. Installed behind existing light switches, it allows users to turn their existing switch into a smart switch and ensures their smart lighting is...
pat gelsinger intel

Incoming Intel CEO Derides Company's Inability to 'Deliver Better Products' Than Apple's M1 Chip

Friday January 15, 2021 6:17 am PST by
Incoming Intel CEO Pat Gelsinger has said that the company must "deliver better products" than Apple, which he described as a "lifestyle company," and says that Intel's best days are "in front of it" (via The Oregonian). Speaking at an Intel all-hands meeting yesterday, Gelsinger derisively implied that Apple is merely a "lifestyle company," so Intel must be able to surpass its technology: ...
mac pro mini feature

Apple Working on Two New Mac Pro Desktops, One of Which Will Be Reminiscent of Power Mac G4 Cube

Friday January 15, 2021 10:23 am PST by
Apple is developing two versions of the Mac Pro to succeed the Mac Pro that was first released in December 2019, according to a new report from Bloomberg. The first updated Mac Pro is a direct successor to the current Mac Pro and it will use the same design. It may also be equipped with Intel processors rather than Apple silicon chips, and it could be one of the sole machines in the Mac...
pioneer carplay wc5700nex

The Best Apple-Related Accessories at CES 2021

Wednesday January 13, 2021 1:16 pm PST by
CES 2021 is taking place digitally this year, and it hasn't been as exciting as in past years because many vendors have opted out. That said, some companies are still showing off some interesting Apple-related accessories that are coming out this year and that will be of interest to Mac, iPad, and iPhone users. Subscribe to the MacRumors YouTube channel for more videos. Pioneer Wireless...