Apple Still Pursuing VR-Based Vehicle Motion Sickness Solution With Contributions From Mark Rober

Back in 2018, it was revealed that noted YouTuber and former NASA engineer Mark Rober had been quietly working in Apple's special projects group on several projects related to virtual reality.

While Rober has since left his position at Apple, the company has continued to pursue patent applications based on his team's work, and a newly published application today relates to the team's efforts to create VR-based solutions for motion sickness experienced by riders in vehicles.

Screenshot 2020 08 13 at 15
The patent, which is titled "Immersive Virtual Display" and is a continuation of a previously filed one on the same topic, shows that Apple has made some changes to the technical claims of the patent, deleting the original 20 claims and adding 20 new ones in an ongoing attempt to protect the concepts developed by the team.

Apple's patent application describes a VR system for vehicles with multiple uses. Simply, the system would provide virtual views that match visual cues with the physical motions that a passenger experiences. The VR experience would be immersive, replacing the view of the real world with a virtual environment. In addition to the obvious opportunities for entertainment, this virtual environment would be able to adjust in real time to accommodate a passenger suffering from motion sickness.

The VR system, which could involve a headset or projection onto a window or other surface, would generate virtual content for providing a view of the virtual environment. Users would be able to select a simulated route from a different location based on the route from the real environment. To do this, the system would compare the turns and curves of the route in the other location to the turns and curves of the route in the real environment, and ensure that they at least partially match.

apple vr motion sickness patent
When this is not possible, the system would augment the simulation of the selected simulated route to ensure that it matches the real-world route. The motions and accelerations of the virtual content would therefore be synchronized with the real-world motions and accelerations of the vehicle. The vehicle itself would require a sensor to be coupled to it to facilitate this.

The filing explains that the vehicle's systems and controls could also be integrated with the VR system to provide physical effects with the virtual experience. The patent makes clear that this would include control of throttle, brakes, suspension, and steering. Furthermore, the fan speed, temperature, and direction of heating and air conditioning could also be changed to provide physical effects to the virtual experience. Plans for the inclusion of sound effects via the car's audio system are also included.

Simulated environments would be stereoscopic to create an illusion of depth, and adjust in real time to provide the illusion of the user moving within the scene. All of this would allow users to feel as if they were physically in a different environment.

The patent specifically outlines how slight changes to perceived motion in the simulated environment that differ from the motions of the real world would treat and prevent motion sickness. For example, visual cues that indicate flow past a passenger may be slowed down or sped up when compared to the actual speed or acceleration of the vehicle to mitigate sickness. In addition to adapting the mapping ratio to help prevent motion sickness, visual, sensory, and audio techniques may be used to increase the comfort passengers suffering from motion sickness.

The filing also refers to a potential mixed reality application of this technology, which may potentially indicate its use in the rumored Apple Glasses product. Alternately, the patent mentions use of this VR system in autonomous vehicles, which could refer to Apple's long-rumored vehicle project.

The patent application says that windows in vehicles are "inherently unsafe and not structurally sound, and add cost to vehicles." Providing a virtual view of the real environment or of a simulated environment would eliminate the need for windows in autonomous vehicles completely. The VR system could also provide passengers with the sensation that they are riding in a larger vehicle than its actual size, which the patent says "may provide passengers with a more pleasant and secure-feeling experience when riding in a small autonomous vehicle."

Apple files dozens of patents application weekly, but patent filings are not always indicative of Apple's immediate plans. Given the complexity and outlandish nature of this filing, it is very unlikely that any of the features outlined in it will come to market any time soon. Nonetheless, it offers insight into Apple's current areas of research and development.

Related Roundups: Apple Car, Apple Glasses

Top Rated Comments

Applebot1 Avatar
9 months ago
I am ?
Score: 9 Votes (Like | Disagree)
now i see it Avatar
9 months ago
so we can all now pretend we're in a Rolls Royce.
Poverty will no longer exist. Just put on this VR headset...

The patent application says that windows in vehicles are "inherently unsafe and not structurally sound, and add cost to vehicles." Providing a virtual view of the real environment or of a simulated environment would eliminate the need for windows in autonomous vehicles completely. The VR system could also provide passengers with the sensation that they are riding in a larger vehicle than its actual size, which the patent says "may provide passengers with a more pleasant and secure-feeling experience when riding in a small autonomous vehicle."
Score: 3 Votes (Like | Disagree)
AngerDanger Avatar
9 months ago

so the key is to replace windows with screens that have a projection of real-world views?
Yeah, it's a bit like robbing a bank wearing a mask made from a photo of your own face.
Score: 3 Votes (Like | Disagree)
magicschoolbus Avatar
9 months ago
Can we focus on teleportation instead?
Score: 2 Votes (Like | Disagree)
Relentless Power Avatar
9 months ago
Side note:

Huge fan of Mark Rober. The Guy Is incredibly talented and shows angles to theories/experiments that take extensive testing For demonstration purposes.
Score: 1 Votes (Like | Disagree)
bjoswald Avatar
9 months ago

Who's interested in Apple glasses?
Sure as hell isn’t me!
Score: 1 Votes (Like | Disagree)

Top Stories

Top Stories 57 Feature

Top Stories: Apple Event Next Tuesday, Mini-LED iPad Pro, iPhone Rumors

Saturday April 17, 2021 6:00 am PDT by
It feels like we've been waiting forever for new Apple products, but the wait is almost over as Apple has announced a media event for next Tuesday, so make sure to tune into MacRumors for full coverage of everything Apple announces. While that was the big news this week, we also got some new details on Apple's iPhone plans for 2022 and 2023 courtesy of analyst Ming-Chi Kuo, and we also saw...
flat imac 3d 3 teal

Reliable Leaker Hints Redesigned Colorful iMac to Debut at 'Spring Loaded' Event

Saturday April 17, 2021 4:43 am PDT by
Reliable leaker known as l0vetodream has hinted that Apple may debut its rumored redesigned and colorful iMac at its "Spring Loaded" event on Tuesday, April 20. In a tweet, the leaker posted an image of Apple's logo used for marketing the upcoming event and an image of the retro rainbow Apple logo alongside the colorful lineup of G3 iMacs. Apple leaker Jon Prosser previously reported that...
third gen Apple pencil leaked video

Video of Alleged Third-Generation Apple Pencil Leaks Ahead of Apple Event

Friday April 16, 2021 6:13 am PDT by
A video purporting to be of the third-generation Apple Pencil has today been shared online, showing a glossy finish that mirrors previous leaks. New ✏️ ready to 🚢 #AppleEvent @TommyBo50387266 pic.twitter.com/s4RCDwDi5M— 漢尼斯·拉斯納 🇨🇳 (@ileakeer) April 16, 2021 The brief video from Twitter account @ileakeer, spotted by 9to5Mac, shows an Apple Pencil with a glossy finish much like the...
important battery message iphone 11

Some iPhone 11 Users Seeing Increased Battery Health Percentages After iOS 14.5 Recalibration Process

Friday April 16, 2021 6:32 am PDT by
In the sixth beta of iOS 14.5, Apple introduced a recalibration process for the battery health reporting system on the iPhone 11, iPhone 11 Pro, and iPhone 11 Pro Max to address inaccurate battery health estimates for some users. Apple said this process might take a few weeks to be completed, and now that two weeks have passed since the sixth beta of iOS 14.5 was released, some users are...
duan rui iphone 12 13 notch

New Images Show Smaller iPhone 13 Notch Compared to iPhone 12

Saturday April 17, 2021 11:38 pm PDT by
Leaker known as "DuanRui" has shared more images that could give us our best look yet at Apple's redesigned notch for the iPhone 13. The new pictures follow similar images shared by the leaker last week, but the latest shots include a comparison with the existing iPhone 12 notch. DuanRui posted three images on Twitter that apparently originate from Weibo, although source details remain...
iphone 13 pro max cads eap

iPhone 13 Series CAD Leaks Reveal Larger Camera Dimensions

Friday April 16, 2021 1:53 am PDT by
Information and alleged CADs of the upcoming iPhone 13 series, shared in a video from EverythingApplePro, indicates that Apple plans to make this year's iPhone camera module significantly bigger, likely to make way for larger sensors and sensor-shift stabilization. According to the CADs shared in the video, the iPhone 13 mini, Pro, and Pro Max camera module will all be a "perfect square."...
maxresdefault

Hands-On With Anker's MagSafe-Compatible Battery Pack

Thursday April 15, 2021 9:39 am PDT by
Anker, a company known for its range of accessories designed for Apple products, recently came out with one of the first MagSafe-compatible battery packs, so we thought we'd check it out to see how it compares to a standard battery pack. Subscribe to the MacRumors YouTube channel for more videos. Design wise, Anker's power bank looks like a typical battery pack, but it has magnets built in...
apple event spring loaded

Apple's 'Spring Loaded' Event Officially Announced for Tuesday, April 20

Tuesday April 13, 2021 9:04 am PDT by
Following an overnight leak by Siri, Apple today officially announced that it will be holding a special "Spring Loaded" event on Tuesday, April 20 at 10:00 a.m. Pacific Time at the Steve Jobs Theater on the Apple Park campus in Cupertino, California. As with all of Apple's 2020 events, the April 2021 event will be a digital-only gathering with no members of the media invited to attend in...
iphone 12 120hz thumbnail feature

LTPO Displays Supporting 120Hz Refresh Rates Again Rumored for iPhone 13 Pro Models

Friday April 16, 2021 10:01 am PDT by
The two higher-end "iPhone 13 Pro" models that are coming in 2021 are expected to use LTPO display technology to enable 120Hz refresh rates, according to display analyst Ross Young. Young reaffirmed the detail in a tweet that said he'd heard rumors about only one model featuring LTPO, which he says is inaccurate. Heard some rumors in the industry and media that there would only be one ...
apple music

Apple Music Tops Spotify With One Cent Paid Per Stream

Friday April 16, 2021 6:44 am PDT by
In a letter slated to be shared with artists today through the Apple Music for Artists dashboard, obtained by The Wall Street Journal, Apple has reportedly revealed that it pays music rights holders one cent per song streamed on Apple Music. The report claims that Apple Music's payment structure is thus roughly double what Spotify pays music rights holders per stream, which averages to about ...