Apple Researching Motion-Sensing Virtual 3D User Interface for iOS Devices

Patently Apple reports on a newly-published patent application from Apple describing the use of motion sensors to create a virtual three-dimensional interface for iOS devices. Utilizing concepts similar those found in a number of existing augmented reality apps, the general device interface could appear as a virtual room that could be navigated by changing the orientation of the device.

The invention covers a 3D display environment for mobile device that uses orientation data from one or more onboard sensors to automatically determine and display a perspective projection of the 3D display environment based on the orientation data without the user physically interacting with (e.g., touching) the display.

Apple describes the use of gyroscope sensors that would allow the "camera view" of the virtual room to rotate as the user rotates their device. Apple also mentions that sensors could be used to detect gestures above the surface of the device's display in order to allow for natural 3D manipulation of the user interface environment.

apple 3d interface iphone
Finally, Apple's patent application discusses a "snap to" feature that would allow users to easily transition between various "walls" within the virtual room.

In another patent application filed in mid-2007, Apple discussed a similar notion of multi-dimensional desktops in Mac OS X, showing a virtual room with various groups of icons on the different walls of the room. Apple followed that up with another patent application looking at hyper-reality displays that would allow for orientation- and motion-based manipulation of 3D objects.

Related Roundup: Apple Vision Pro
Tag: Patent
Buyer's Guide: Vision Pro (Buy Now)
Related Forum: Apple Vision Pro

Popular Stories

Early Black Friday Deals 1

The Best Early Black Friday Apple Deals on AirPods, Apple Watch, iPad, and More

Saturday November 8, 2025 6:16 am PST by
We're officially in the month of Black Friday, which will take place on Friday, November 28 in 2025. As always, this will be the best time of the year to shop for great deals, including popular Apple products like AirPods, iPad, Apple Watch, and more. In this article, the majority of the discounts will be found on Amazon. Note: MacRumors is an affiliate partner with some of these vendors. When ...
2024 iPhone Boxes Feature

Apple Adjusts Trade-In Values for iPhones, iPads, Macs, and More

Thursday November 6, 2025 11:12 am PST by
Apple today updated its trade-in values for select iPhone, iPad, Mac, and Apple Watch models. Trade-ins can be completed on Apple's website, or at an Apple Store. The charts below provide an overview of Apple's current and previous trade-in values in the U.S., according to its website. Maximum values for most devices either decreased or saw no change, but the iPad Air received a slight bump. ...
All Screen iPhone 2027 Feature 1

Apple to Hide Selfie Camera Under Display of 20th Anniversary iPhone

Monday November 10, 2025 1:55 am PST by
Apple will conceal the front-facing camera under the screen of its 2027 iPhone, a Chinese leaker said today, corroborating reports that Apple's 20th anniversary iPhone will have no visible cutouts in the display. Weibo-based account Digital Chat Station said Apple's development of under-screen camera technology was progressing as planned for adoption in 2027, one year after it will...
Apple fitness plus feature

Future of Apple Fitness+ 'Under Review'

Sunday November 9, 2025 5:30 am PST by
The future of Apple Fitness+ is "under review" amid a reorganization of the service, according to Bloomberg's Mark Gurman. In the latest edition of his "Power On" newsletter, Gurman said that Apple Fitness+ remains one of the company's "weakest digital offerings." The service apparently suffers from high churn and little revenue. Nevertheless, Fitness+ has a small, loyal fanbase that...
m1 chip slide

Five Years of Apple Silicon: M1 to M5 Performance Comparison

Monday November 10, 2025 1:08 pm PST by
Today marks the fifth anniversary of the Apple silicon chip that replaced Intel chips in Apple's Mac lineup. The first Apple silicon chip, the M1, was unveiled on November 10, 2020. The M1 debuted in the MacBook Air, Mac mini, and 13-inch MacBook Pro. The M1 chip was impressive when it launched, featuring the "world's fastest CPU core" and industry-leading performance per watt, and it's only ...
iphone air thinness

iPhone Air Sales Are So Bad That Apple's Delaying the Next-Generation Version

Monday November 10, 2025 11:41 am PST by
The thin, light iPhone Air sold so poorly that Apple has decided to delay the launch of the next-generation iPhone Air that was scheduled to come out alongside the iPhone 18 Pro, reports The Information. Apple initially planned to release a new iPhone Air in fall 2026, but now that's not going to happen. Since the iPhone Air launched in September, there have been reports of poor sales...
Liquid Glass General Feature

Apple Shares Liquid Glass Design Gallery

Thursday November 6, 2025 2:45 pm PST by
Apple is promoting the new Liquid Glass design in iOS 26, showing off the ways that third-party developers are embracing the aesthetic in their apps. On its developer website, Apple is featuring a visual gallery that demonstrates how "teams of all sizes" are creating Liquid Glass experiences. The gallery features examples of Liquid Glass in apps for iPhone, iPad, Apple Watch, and Mac. Apple...
iOS 26

iOS 26.1 Available Now With These 8 New Features

Monday November 3, 2025 5:54 am PST by
Following more than a month of beta testing, Apple released iOS 26.1 on Monday, November 3. The update includes a handful of new features and changes, including the ability to adjust the look of Liquid Glass and more. Below, we outline iOS 26.1's key new features. Liquid Glass Toggle iOS 26.1 lets you choose your preferred look for Liquid Glass. In the Settings app, under Display...
iPhone Satellite Feature

Apple Developing These 5 New Satellite Features for iPhone

Sunday November 9, 2025 6:07 am PST by
Apple is working on a series of new satellite connectivity features for the iPhone, Bloomberg's Mark Gurman reports. In this week's "Power On" newsletter, Gurman revealed that the new features in development include: Apple Maps via satellite: Navigation in Apple Maps without cellular or Wi-Fi connectivity. Photos in Messages via satellite: Support for sending photos in the Messages...
maxresdefault

In-Depth iPhone Battery Experiment Pits Slow Charging Against Fast Charging

Friday November 7, 2025 1:19 pm PST by
HTX Studio this week shared the results from a six-month battery test that compared how fast charging and slow charging can affect battery life over time. Using six iPhone 12 models, the channel set up a system to drain the batteries from five percent and charge them to 100 percent over and over again. Three were fast charged, and three were slow charged. Another set of iPhones underwent...

Top Rated Comments

RoelJuun Avatar
181 months ago
In a flash I read Apple adopting a Research In Motion interface. The horror.

On Topic:

I still don't believe in 3D interfaces/screens. My eyes get strained after a while. But then again, Apple is usually implementing technologies when they believe they have something really good to offer.
Score: 7 Votes (Like | Disagree)
Fuzzball7 Avatar
180 months ago
Imagine the lag if Jailbroken.. geez
Score: 2 Votes (Like | Disagree)
HiRez Avatar
181 months ago
It reminds me of this (//www.youtube.com/watch?v=dFUlAQZB9Ng), an interface I thought looked clumsy even in 1993.
Score: 2 Votes (Like | Disagree)
SockRolid Avatar
181 months ago
crazy, weird and illogical, indeed.

Thanks! I aim to please. :-)

----------

Do you have something in mind? I really like how it is.

The best thing about iOS is its ability to quickly get out of your way. There's almost nothing between you and your apps and data. Just a few swipes to get to the right page of icons, then a tap to launch the app itself.

So, what's the glaringly obvious way to make it even easier to get to a specific app?

"Siri, launch Maps." And "Siri, open MacRumors.com." No bizarre 3-d "walls" needed.
Score: 2 Votes (Like | Disagree)
The Phazer Avatar
181 months ago
There are several apps in the App Store that already do exactly this, *even on iOS*.

If the US Patents Office doesn't throw this out under prior art instantly the place may as well get burnt down.

Phazer
Score: 2 Votes (Like | Disagree)
rmwebs Avatar
181 months ago
I may be 100% wrong here so forgive me, but doesn't the 3DS already do this? I was under the impression that the screen does software based 3d rendering using facial tracking to determine where you are, thus where the 3d display needs to position the content.

I could be way off so any input from a 3DS owner would help!
Score: 2 Votes (Like | Disagree)