Got a tip for us? Share it...

Apple Refining the Touch Screen Interface? Evidence for a Tablet Mac?

Throughout 2005, Apple continued to apply for numerous touch-screen technology patents. These patents aren't simply attributable to the rumored touch-screen iPod. Many of the patents have shown Mac OS X elements and interfaces.

The most recent addition was filed in September 2005 and called "Operation of a computer with touch screen interface". Again, individuals at Apple appear to be spending a lot of time on the potential interface for users of a touch screen device. The patent describes the the possible advantage of touch screens by being able to "glean much more information about a user's actions" than from conventional keyboards.

The methods described are intriguing in that it appears that there could be a level of refinement to the touch interface that has not been present in previous devices. Again, Apple describes the utility of offering a multi-touch capable display which can process multiple figures and gestures to provide additional information.

The authors describe a number of interesting potential techniques to gather more information from the user operating the virtual interface (keyboard and GUI elements on the screen)

- Both pressure and time of screen presses could also be used to interpret action and intention by the users. (Chart)
- In one example, the user might be required to hold down on a "delete" button longer than is required to activate the "keep" button for an item. The delete function requiring more time to ensure that data is not accidentally erased. (Picture)
- Gestures are described to provide additional "hidden" functionality. For example, in describing an on-screen keyboard, a user could press on the letter "e" and then stroke the finger in a particular direction away from the letter to invoke a special variation (such as ). (Picture). Of historical interest, individuals at Apple had done research into similar point/flick gesture interfaces in 1994 ("T-Cube: a fast, self-disclosing pen-based alphabet") when researching alternative input methods for the Newton.
- Additional gestures may be required to activate special functionality... "wiggle" is given as an example. Again, the Newton allowed users to erase text by simply performing a zig-zag "crossing out" gesture over the text. (Quicktime Movie).

While patent applications do not necessarily mean these technologies will turn up as shipping products, it's clear a significant portion of research at Apple involves touch-screen technology. Rumors of a Tablet Mac last peaked in 2003 with a traditionally reliable source of information pointing to a Mac OS X tablet at that time:

(2003) My sources sketch the following picture: A device that superficially resembles a large iPod with an 8-inch diagonal screen, lacks a keyboard, packs USB and FireWire ports, and runs Mac OS X along with a variety of multimedia goodies.


Steve Jobs was skeptical of the success of the Tablet form factor in 2002. Indeed, the Tablet PC's have not been a great success, but with Microsoft/Intel's introduction of the Ultra Mobile PC form factor, the market may see a renewed interest in tablet devices.

As a final interesting hint, in July of 2005 a small company called FingerWorks cryptically posted that they had ceased operations as a business. Multiple reports indicated that the company had been sold, but details were scarce. According to individuals close to the company, Apple had indeed purchased the company and related technology/patents. At the time, FingerWorks had offered advanced input devices, including a multi-touch product called iGesture Pad which allowed users to use Gestures to interface with their Mac. At the time it was thought that Apple was interested in touch and click-wheel related technology for the iPod, but the Gesture/MultiTouch technology may have been an important part of the acquisition.

Top Rated Comments

(View all)

81 months ago
The plot thickens...

Though not necessarily in the market for such a device, if in the future Apple comes out with as elegant of a product as is implied, I may have to give them my money out of sheer appreciation...

I look forward to seeing this come to fruition, though I look less forward to yet more threads discussing this (as of now) phantom device.
Rating: 0 Positives / 0 Negatives
81 months ago
Maybe Jobs was telegraphing exactly what they are working on with the 8" iPod screen (minus the 10 pound weight, hopefully). Here's hoping!
Rating: 0 Positives / 0 Negatives
81 months ago
This sounds like the future of computing to me. Seriously, I don't think keyboards and mice are going to be around forever. It'll be interesting to see how things play out..

I reserve the right to be totally wrong and change my mind about this at any given time though.

How postmodern of me. :p
Rating: 0 Positives / 0 Negatives
81 months ago
There's a downside to some of these methods. Just as you have to learn the various combinations of shift/control/option/command with other keys to use those functions, using gestures to invoke functions means you have more methods to learn, and there may be no visible indicators of what they are.

Holding a key longer might be convenience as a way to make an indication of your meaning, but only if you know to do that. The same with holding a key while making a gesture.

The average user can learn a few gestures, but not dozens and dozens all at once, so they'd have to learn them over time.
Rating: 0 Positives / 0 Negatives
81 months ago
Given the hugely underwhealming interest in tablets (and microsoft can push things to be bought even if they're crappy, we know), I think it's obvious that a computer without a decent input device just doesn't make sense. See my post earlier today for more on that.

Hope this is wrong, it just seems like an idea nerds would love and everybody else wouldn't touch.
Rating: 0 Positives / 0 Negatives
81 months ago


Holding a key longer might be convenience as a way to make an indication of your meaning, but only if you know to do that. The same with holding a key while making a gesture.


I actually thought the impressive part of the examples given is that they are relatively intuitive or could be.

The pressing longer isn't something that needs to be told. If someone hits a button and it doesn't respond, the natural response is to hold it down harder/longer. I don't think we're talking about holding it down for 10 seconds. Probably 1-2 seconds instead of instantly.

As for the gesture letters. I think if you held down the character, the special characters would appear around the original letter. So as you became familiar with them, you could simply gesture instead of hold down and look at the pop-up menu. That's how I interpreted the description. Also it's how the T-Cube (Newton) interface worked. Press and hold and a menu came up, then you could gesture the correct direction. Otherwise, you could just click and flick without waiting if you knew what you were doing.


arn
Rating: 0 Positives / 0 Negatives
81 months ago

I think it's obvious that a computer without a decent input device just doesn't make sense. See my post earlier today for more on that.

Hope this is wrong, it just seems like an idea nerds would love and everybody else wouldn't touch.

I agree that a computer without a decent input just doesn't make sense, but I think Apple, king of all UIs, would never release a Tablet without a great UI and input system. I remember a story about Steve Jobs using the prototype iPod ..... he'd yell at the workers if he couldn't find a song in 5 seconds ... and I can just see Jobs saying, "Why can't I type an email in a under 5 minutes?" If the MacTablet ever comes out, it'll be awesome.
Rating: 0 Positives / 0 Negatives
81 months ago
Hearing all of the talk about Newton makes me miss my old friend... Oh - and that video is a really crappy illustration of the scribble... You could really scribble it out vigorously like you would scribble out stuff normally - and it would work like magic...

Steve Jobs killed the Newton as one of his first acts as iCeo - and ticked off a lot of the developers...

They could just release a small color version of the Newton with a faster processor and built-in grafitti support (along with the option to turn on the handwriting recognition) and they would make me very happy... Oh, and add on a music player (iPod) and you would rule the world...

Come back Newton... come back!
Rating: 0 Positives / 0 Negatives
81 months ago
God I hope they're working on a portable touch device. I would very much like to purchase such an iPod/Mac tablet, what I would imagine would look like a more elegant and simplified variant of Microsoft's ugly and unwieldly looking Origami. I would hope it would offer wifi and a small selection of OSX's best apps and widget compatibility. I don't need a full laptop but I'd like something that would sync to the Mac and would offer more than just music/video/photos.
Rating: 0 Positives / 0 Negatives
81 months ago
That's a nice roundup thanks. I'm intrigued to see how Apple will enter this market if they do infact plan on doing so. I see a fully bloan tablet as unlikely but what this information suggests to me is an iPod/Tablet venture, simular to that of Samsung's new announcement is already be in Apple plans.
Rating: 0 Positives / 0 Negatives

[ Read All Comments ]