Apple Working on 3D 'Hyper-Reality' Displays

Apple's patent applications always provide an interesting peek into what Apple researchers have been working on. In one of the more interesting patent applications we've discovered, Apple appears to be researching 3D displays in which the user will be able to look around an object.

In order to view a 3D object from various angles on your screen at present, you are required to use the mouse or keyboard to manipulate the object. This might simply involve clicking and dragging to pan or rotate an object. While functional, Apple considers this to be unintuitive and potentially frustrating to new users.

050903 look3 600

Apple proposes that a display could change the perspective of the 3D objects based on the users' relative position. Said display would detect the user's position through any suitable approach (such as video, infrared, electromagnetic fields etc...). Video, of course, is the most likely possibility with a camera mounted at the top of the display itself, thus allowing the computer to determine the user's location and position. The user could then move their head left and right to look around a 3D object as shown in the example image above. Apple also suggests that it could also be applied to 2D objects like windows to provide some added depth to traditionally flat objects:

051335 look4 600

In fact, Apple suggests that software could be so advanced as to incorporate elements of the user's environments into the scene on the display.

For example, the electronic device may define visual properties of different surfaces of the displayed object (e.g., reflection and refraction characteristics), and apply the visual properties to the portions of the detected image mapped on each surface. Using this approach, surfaces with low reflectivity (e.g., plastic surfaces) may not reflect the environment, but may reflect light, while surfaces with high reflectivity (e.g., polished metal or chrome) may reflect both the environment (e.g., the user's face as detected by the camera) and light. To further enhance the user's experience, the detected environment may be reflected differently along curved surfaces of a displayed object (e.g., as if the user were actually moving around the displayed object and seeing his reflection based on his position and the portion of the object reflecting the image).

Apple has been researching these sorts of novel display types for years. Back in 1995, they had even had a similar system built in the lab and referred to these displays as "Hyper Reality" displays. Apple, of course, is not the only company working on such technology. This YouTube video shows this system in action (thanks djellison) on a make-shift Wii system, demoed by Johnny Lee:

Related Forum: Mac Accessories

Popular Stories

Apple WWDC23 macOS Sonoma hero

macOS Sonoma Launching This Week With These New Features

Sunday September 24, 2023 12:45 pm PDT by
Apple previously announced that macOS Sonoma will be released this Tuesday, September 26. The free software update includes many new features and changes for the Mac, including the five that we have highlighted below. In addition to these five features, we have shared the full release notes for macOS Sonoma below for a complete overview of everything new. Desktop Widgets macOS Sonoma...
iPhone 16 Mock Header With Dynamic Island

Skipping the iPhone 15 Pro? Here's What's Rumored for iPhone 16 Pro

Friday September 22, 2023 9:29 am PDT by
Are you skipping the iPhone 15 Pro and waiting another year to upgrade? If so, we already have some iPhone 16 Pro rumors for you. Below, we recap new features rumored for the iPhone 16 Pro models so far:Larger displays: The iPhone 16 Pro and iPhone 16 Pro Max will be equipped with larger 6.3-inch and 6.9-inch displays, respectively, according to Ross Young, CEO of Display Supply Chain...
iPhone 16 Side Feature

iPhone 16 to Include an Additional Capacitive 'Capture' Button

Monday September 25, 2023 12:50 pm PDT by
The iPhone 16 series is expected to gain an additional capacitive button, known internally as the "Capture Button." Codenamed "Project Nova," the button is likely to be one of the main selling points of the iPhone 16 lineup, assuming it gets past the initial testing phase. The Capture Button is located on the same side as the Power button, only positioned slightly lower - where the mmWave cutout...
ipad mini blue

Apple to Launch iPad Mini 7 Later This Year, Industry Report Suggests

Monday September 25, 2023 3:16 am PDT by
Apple could be preparing to release a seventh-generation iPad mini before the end of the year, based on a new report by DigiTimes. In an article discussing stagnating global tablet demand in the second half of 2023, the Taiwan-based outlet forecasts an uptick in Apple's share of the market owing to orders for a "small-size" iPad in the fourth quarter. From the report (see bold): In the...