Apple Multi-Touch Display?

As a final note in the recent flurry of Apple Tablet and Gesture patents, one user points out some interesting possible relationships between Apple's recent patents.

One video has received a lot of attention. It is a video by Jeff Han on his research into Multi-Touch displays. The impressive display shows a user using multiple fingers/hands in manipulating objects on the screen. A closer look at technology behind the demonstration reveals that it is a very intricate setup.

The system shown uses a technique called Frustrated Total Internal Reflection (FTIR) to accomplish the tasks shown. It involves the use of a transparent screen with the images rear-projected onto it. For touch-sensing, a camera is placed behind the screen to detect the user interaction. A diagram of the setup is shown here.

The use of both a projector and rear-camera, of course, is not feasible in any potential laptop or tablet device from Apple... but conveniently enough, Apple has recently applied for a patent on an Integrated Sensing Display (diagram) providing a screen that can be used both as a display and as a camera:

The integrated sensing display includes both display elements and image sensing elements. As a result, the integrated sensing device can not only output images but also input images.

At the time, many users dismissed the need for such an elaborate display when the built-in iSights offer a reasonable solution for video-conferencing needs. Of course, the use of this "integrated sensing" display would not likely use the FTIR method as described above, but could offer similar multi-touch functionality.

Apple has recently demonstrated a need for a multi-touch display in their recent Gesture patent application, specifically in this image.

Update: Hrmph previously noted a European patent application from Apple for a "Multi-point touchscreen" -- allowing up to 15 simultaneous presses.

Popular Stories

iOS 18 Mock iPhone 16 Feature Gray

Revealed: iOS 18 Works With These iPhone Models

Monday June 10, 2024 3:57 am PDT by
iOS 18 will be compatible with the same iPhone models as iOS 17, according to a post on X today from a private account with a proven track record of sharing build numbers for upcoming iOS updates. iOS 18 will be compatible with the iPhone XR, and hence also the iPhone XS and iPhone XS Max models with the same A12 Bionic chip, but older iPhone models will miss out. Here is the full...
ios 18 tile summary

Apple Announces iOS 18 With New Customization Features, Redesigned Photos App, and More

Monday June 10, 2024 10:17 am PDT by
Apple today previewed iOS 18, the next major update to the operating system for the iPhone, with new customization features, a redesigned Photos app, and more. iOS 18 features new customization tools for the Home Screen. App icons now feature Dark Mode and users can tint them with a color to create a unique look. Apps can also now be placed anywhere on the Home Screen freely. The Control...
WWDC24 Live Coverage Article

WWDC 2024 Apple Event Live Keynote Coverage: iOS 18, Apple's AI Push, and More

Monday June 10, 2024 9:20 am PDT by
Apple's Worldwide Developers Conference (WWDC) starts today with the traditional keynote kicking things off at 10:00 a.m. Pacific Time. MacRumors is on hand for the event and we'll be sharing details and our thoughts throughout the day. We're expecting to see a number of software-related announcements with a focus on Apple's efforts to infuse AI throughout its operating systems and apps....
iOS 18 Siri Integrated Feature

Massive iPhone Upgrade Coming This Week But These Devices Will Miss Out

Sunday June 9, 2024 1:25 pm PDT by
Apple is planning a major AI overhaul in iOS 18, with a feature set it is referring to as "Apple Intelligence." However, these new features will not work on older iPhones, even if they do appear on the new operating system's device compatibility list. Apple's initial AI roadmap for iOS 18 is said to come in two parts: Basic AI features that will be processed on-device, and more advanced...
Next Gen CarPlay WWDC24 1

Apple Provides Updated Look at Next-Generation CarPlay at WWDC 2024

Monday June 10, 2024 7:11 pm PDT by
Apple today shared a few WWDC 2024 coding sessions related to its upcoming next-generation CarPlay system ahead of its launch later this year. The sessions include lots of updated next-generation CarPlay images, with one revealing new Vehicle, Media, and Climate apps in action for the first time. MacRumors previously discovered evidence of these apps in the iOS 17.4 beta. Next-generation...
iPad Air 5

New: iPadOS 18 Drops Support for These iPad Models

Monday June 10, 2024 4:16 am PDT by
iPadOS 18 will drop support for iPad models equipped with the A10X Fusion chip, according to a post on X today from a private account with a proven track record of sharing build numbers for upcoming iOS and iPadOS updates. In other words, iPadOS 18 will drop support for the 10.5-inch iPad Pro and the second-generation 12.9-inch iPad Pro. Support for the sixth-generation iPad, which uses the...
ios 18 button bulge

iOS 18 Adds Pop-Out Bezel Animation When Pressing iPhone Buttons

Tuesday June 11, 2024 10:40 am PDT by
iOS 18 includes a small but interesting change for the buttons on the iPhone, adding more of a visual element when changing volume, activating the Action button, or locking the screen. When you press an iPhone button in iOS 18, the display bezel bulges outward slightly. This feature is available for the volume buttons, Action button and the power button, and it will also likely be used for...