Apple Researching Motion-Sensing Virtual 3D User Interface for iOS Devices

Patently Apple reports on a newly-published patent application from Apple describing the use of motion sensors to create a virtual three-dimensional interface for iOS devices. Utilizing concepts similar those found in a number of existing augmented reality apps, the general device interface could appear as a virtual room that could be navigated by changing the orientation of the device.

The invention covers a 3D display environment for mobile device that uses orientation data from one or more onboard sensors to automatically determine and display a perspective projection of the 3D display environment based on the orientation data without the user physically interacting with (e.g., touching) the display.

Apple describes the use of gyroscope sensors that would allow the "camera view" of the virtual room to rotate as the user rotates their device. Apple also mentions that sensors could be used to detect gestures above the surface of the device's display in order to allow for natural 3D manipulation of the user interface environment.


Finally, Apple's patent application discusses a "snap to" feature that would allow users to easily transition between various "walls" within the virtual room.

In another patent application filed in mid-2007, Apple discussed a similar notion of multi-dimensional desktops in Mac OS X, showing a virtual room with various groups of icons on the different walls of the room. Apple followed that up with another patent application looking at hyper-reality displays that would allow for orientation- and motion-based manipulation of 3D objects.

Related Roundup: Apple Glasses
Tag: patent

Top Rated Comments

(View all)
Avatar
112 months ago
In a flash I read Apple adopting a Research In Motion interface. The horror.

On Topic:

I still don't believe in 3D interfaces/screens. My eyes get strained after a while. But then again, Apple is usually implementing technologies when they believe they have something really good to offer.
Score: 7 Votes (Like | Disagree)
Avatar
112 months ago
Imagine the lag if Jailbroken.. geez
Score: 2 Votes (Like | Disagree)
Avatar
112 months ago
It reminds me of this (//www.youtube.com/watch?v=dFUlAQZB9Ng), an interface I thought looked clumsy even in 1993.
Score: 2 Votes (Like | Disagree)
Avatar
112 months ago

crazy, weird and illogical, indeed.


Thanks! I aim to please. :-)

----------

Do you have something in mind? I really like how it is.


The best thing about iOS is its ability to quickly get out of your way. There's almost nothing between you and your apps and data. Just a few swipes to get to the right page of icons, then a tap to launch the app itself.

So, what's the glaringly obvious way to make it even easier to get to a specific app?

"Siri, launch Maps." And "Siri, open MacRumors.com." No bizarre 3-d "walls" needed.
Score: 2 Votes (Like | Disagree)
Avatar
112 months ago
There are several apps in the App Store that already do exactly this, *even on iOS*.

If the US Patents Office doesn't throw this out under prior art instantly the place may as well get burnt down.

Phazer
Score: 2 Votes (Like | Disagree)
Avatar
112 months ago
I may be 100% wrong here so forgive me, but doesn't the 3DS already do this? I was under the impression that the screen does software based 3d rendering using facial tracking to determine where you are, thus where the 3d display needs to position the content.

I could be way off so any input from a 3DS owner would help!
Score: 2 Votes (Like | Disagree)

Top Stories

Apple Announces New 27-Inch iMac With 10th-Gen Processors, Up to 128GB RAM, 1080p Webcam, True Tone, and More

Tuesday August 4, 2020 8:07 am PDT by
Apple today announced a new 27-inch iMac with faster 10th-generation Intel Core processor options, next-generation AMD graphics, up to 128GB of RAM, a higher-resolution 1080p front-facing FaceTime camera, a True Tone display with a nano-texture glass option, a T2 chip, higher fidelity speakers, studio-quality microphones, and more. A breakdown of the new 27-inch iMac's features and specs:10th...

Apple May Launch This Year's 'iPhone 12' Lineup in Two Stages, With 6.1-inch Models Debuting First

Monday August 3, 2020 3:14 am PDT by
Apple last week confirmed that its "‌iPhone‌ 12" launch will be delayed this year due to the ongoing global health crisis and restrictions on travel. Apple last year started selling iPhones in late September, but this year, Apple projects supply will be "available a few weeks later," suggesting a release sometime in October. We're expecting a total of four OLED iPhones in 5.4, 6.1, and...

Apple-Acquired Dark Sky Officially Shuts Down Android App

Saturday August 1, 2020 3:43 pm PDT by
Apple in March purchased weather app Dark Sky, and at that time, Dark Sky's developers said that the app's Android version would be discontinued on July 1, 2020. However, instead of shuttering the app on that date, the app's developers announced that the discontinuation would be delayed for another month. Now that it's August, Android users are no longer able to access the app, and...

Everything New in iOS 14 Beta 4: Apple TV Widget, Search Improvements, Exposure Notification API and More

Tuesday August 4, 2020 11:14 am PDT by
Apple today released the fourth developer betas of iOS and iPadOS 14 for testing purposes, tweaking and refining some of the features and design changes included in the update. Changes get smaller and less notable as the beta testing period goes on, but there are still some noteworthy new features in the fourth beta, which we've highlighted below. - Apple TV widget - There's a new Apple TV...

Apple Explains Why You Might See 'Not Charging' When a Mac is Plugged In

Monday August 3, 2020 1:42 pm PDT by
If you have a Mac and have seen a "Not Charging" warning when plugging it in to power, Apple last week released a support document that explains why. Macs running macOS 10.15.5 or later have a Battery Health Management feature to preserve the life of the battery, and occasionally, the Battery Health Management option will cause the Mac to pause its charging for calibration purposes.Depending ...

Unreleased iPod Touch with Mac Pro Glossy Black Finish Shared Online

Sunday August 2, 2020 11:32 am PDT by
Twitter user @DongleBookPro has today posted images of what seems to be a first-generation iPod Touch prototype with a 2013 Mac Pro-style glossy black finish. The Twitter user claims that the iPod Touch prototype pictured has "the same coating as the 2013 Mac Pro." Had the finish been selected for the final product, it also would have been similar to the metallic glossy black finish that...

Phil Schiller Moving on to Become 'Apple Fellow,' Greg Joswiak Taking Over as Marketing SVP

Tuesday August 4, 2020 10:07 am PDT by
Apple's Phil Schiller is moving on to become an "Apple Fellow," Apple announced today, while Greg Joswiak will take over as Apple's senior vice president of Worldwide Marketing. Schiller will continue to lead the App Store and Apple Events, but will no longer be in charge of marketing. Apple CEO Tim Cook said he is "thrilled" that Joswiak will be leading the marketing team, and that his...

Microsoft to Stop Supporting Office 2016 for Mac in October

Monday August 3, 2020 12:21 pm PDT by
Microsoft's Office 2016 for Mac is set to reach its end of support date on October 13, 2020, and after that date, connecting to Office 365 services using the Office 2016 for Mac software will no longer be supported. Microsoft shared the detail in a support document from July highlighting which versions of Office will be supported for connecting to Office 365 services in the future.Connecting ...

8 Third-Party Home Screen Widgets That You Can Try Out Now on iOS 14

Wednesday August 5, 2020 12:56 pm PDT by
One of the biggest new features of iOS 14 is Home Screen widgets, which provide information from apps at a glance. The widgets can be pinned to the Home Screen in various spots and sizes, allowing for many different layouts. When the iOS 14 beta was first released in June, widgets were limited to Apple's own apps like Calendar and Weather, but several third-party developers have begun to test ...

Apple Shares Requirements for Default Third-Party Browser and Email Apps With Developers

Monday August 3, 2020 4:28 pm PDT by
Apple in iOS 14 plans to allow users to set a third-party app as the default email or browser app on an iPhone or iPad, replacing the current Apple-made default apps Safari and Mail. Apple hasn't provided many details on the new feature to users, but as noted by MacStories' Federico Vittici, Apple has shared documentation with developers who want their apps to have the option to be set as a...