Skip to Content

Apple Multi-Touch Display?

As a final note in the recent flurry of Apple Tablet and Gesture patents, one user points out some interesting possible relationships between Apple's recent patents.

One video has received a lot of attention. It is a video by Jeff Han on his research into Multi-Touch displays. The impressive display shows a user using multiple fingers/hands in manipulating objects on the screen. A closer look at technology behind the demonstration reveals that it is a very intricate setup.

The system shown uses a technique called Frustrated Total Internal Reflection (FTIR) to accomplish the tasks shown. It involves the use of a transparent screen with the images rear-projected onto it. For touch-sensing, a camera is placed behind the screen to detect the user interaction. A diagram of the setup is shown here.

The use of both a projector and rear-camera, of course, is not feasible in any potential laptop or tablet device from Apple... but conveniently enough, Apple has recently applied for a patent on an Integrated Sensing Display (diagram) providing a screen that can be used both as a display and as a camera:

The integrated sensing display includes both display elements and image sensing elements. As a result, the integrated sensing device can not only output images but also input images.

At the time, many users dismissed the need for such an elaborate display when the built-in iSights offer a reasonable solution for video-conferencing needs. Of course, the use of this "integrated sensing" display would not likely use the FTIR method as described above, but could offer similar multi-touch functionality.

Apple has recently demonstrated a need for a multi-touch display in their recent Gesture patent application, specifically in this image.

Update: Hrmph previously noted a European patent application from Apple for a "Multi-point touchscreen" -- allowing up to 15 simultaneous presses.

Popular Stories

MacBook Neo Feature Pastel 1

First MacBook Neo Benchmarks Are In: Here's How It Compares to the M1 MacBook Air

Thursday March 5, 2026 4:07 pm PST by
Benchmarks for the new MacBook Neo surfaced today, and unsurprisingly, CPU performance is almost identical to the iPhone 16 Pro. The MacBook Neo uses the same 6-core A18 Pro chip that was first introduced in the iPhone 16 Pro, but it has one fewer GPU core. The MacBook Neo earned a single-core score of 3461 and a multi-core score of 8668, along with a Metal score of 31286. Here's how the...
imac video apple feature

Apple Unveils Seven New Products

Friday March 6, 2026 11:48 am PST by
Apple this week unveiled seven products, including an iPhone 17e, an iPad Air with the M4 chip, updated MacBook Air and MacBook Pro models, a new Studio Display, a higher-end Studio Display XDR, and an all-new MacBook Neo that starts at just $599. iPhone 17e features the same overall design as the iPhone 16e, but it gains Apple's A19 chip, MagSafe for magnetic wireless charging and magnetic...
Apple MacBook Pro M4 hero

Apple Planning 'MacBook Ultra' With Touchscreen and Higher Price

Sunday March 8, 2026 8:05 am PDT by
Apple is planning to launch an all-new "MacBook Ultra" model this year, featuring an OLED display, touchscreen, and a higher price point, Bloomberg's Mark Gurman reports. Gurman revealed the information in his latest "Power On" newsletter. While Apple has been widely expected to launch new M6-series MacBook Pro models with OLED displays, touchscreen functionality, and a new, thinner design...