Apple Multi-Touch Display? - MacRumors
Skip to Content

Apple Multi-Touch Display?

As a final note in the recent flurry of Apple Tablet and Gesture patents, one user points out some interesting possible relationships between Apple's recent patents.

One video has received a lot of attention. It is a video by Jeff Han on his research into Multi-Touch displays. The impressive display shows a user using multiple fingers/hands in manipulating objects on the screen. A closer look at technology behind the demonstration reveals that it is a very intricate setup.

The system shown uses a technique called Frustrated Total Internal Reflection (FTIR) to accomplish the tasks shown. It involves the use of a transparent screen with the images rear-projected onto it. For touch-sensing, a camera is placed behind the screen to detect the user interaction. A diagram of the setup is shown here.

The use of both a projector and rear-camera, of course, is not feasible in any potential laptop or tablet device from Apple... but conveniently enough, Apple has recently applied for a patent on an Integrated Sensing Display (diagram) providing a screen that can be used both as a display and as a camera:

The integrated sensing display includes both display elements and image sensing elements. As a result, the integrated sensing device can not only output images but also input images.

At the time, many users dismissed the need for such an elaborate display when the built-in iSights offer a reasonable solution for video-conferencing needs. Of course, the use of this "integrated sensing" display would not likely use the FTIR method as described above, but could offer similar multi-touch functionality.

Apple has recently demonstrated a need for a multi-touch display in their recent Gesture patent application, specifically in this image.

Update: Hrmph previously noted a European patent application from Apple for a "Multi-point touchscreen" -- allowing up to 15 simultaneous presses.

Popular Stories

WWDC26 MR Live Coverage Article

WWDC 2026 Apple Event Live Keynote Coverage: iOS 27, Revamped Siri, and More

Monday June 8, 2026 9:15 am PDT by
Apple's Worldwide Developers Conference (WWDC) starts today with the traditional keynote kicking things off at 10:00 a.m. Pacific Time. MacRumors is on hand for the event and we'll be sharing details and our thoughts throughout the day. We're expecting to see a number of software-related announcements today, headlined by a reset on Apple's push into AI that should see a significant overhaul...
macOS Golden Gate Mac

Apple Announces macOS 27 Golden Gate With New Siri and 'Tons' of Refinements

Monday June 8, 2026 10:19 am PDT by
Apple today announced that macOS 27 is named macOS Golden Gate. Much like Mac OS X Snow Leopard in 2009, Apple said it focused on improving macOS's performance and dozens of underlying technologies this year. Apple says macOS Golden Gate offers quicker AirDrop transfers, faster network file browsing, improved syncing in the Messages app, better Spotlight search suggestions, and other...
apple intelligence architecture

Apple Reveals New AI Architecture Built Around Google Gemini Models

Monday June 8, 2026 10:38 am PDT by
Apple today announced a major overhaul of its Apple Intelligence platform, revealing a new architecture built on foundation models developed in collaboration with Google using the technologies behind the Gemini family. The new architecture centers on Apple Foundation Models co-developed with Google, which Apple says are adapted to run both on-device and on servers through its existing...