iSlate Input Alternatives: Handwriting Recognition Without a Stylus and Much More

As rumors of an Apple tablet reach a frenzy, there's no shortage of opinions of what Apple could or should do in an upcoming tablet device. One major question that has remained is the input method that Apple will choose to adopt for the tablet. This became the most obvious issue when you start holding 10-inch tablets as we did at CES. Traditional soft keyboards simply don't scale well in size. Gizmodo summarizes and explores the problem well:

I had a chance to play with a few different sizes of tablets at CES, nearly all of which had traditional onscreen keyboards -- in particular, the Android 2.0 keyboard, which is aesthetically different but functionally almost identical to iPhone OSes. None of them worked, at least in the way that I wanted them to, for one reason: they were too big. Seven-inch tablets were too large to comfortably thumb-type on, while 10-inch tablets made text input all but impossible.

This exact issue dates back to when Apple first introduced the Newton MessagePad, which offered handwriting recognition as its primary input. One of the main benefits of handwriting recognition was the fact that it could be used while standing and holding a slate-type device. As device sizes shrank over the years and chiclet keyboards, and subsequently touch-screen keyboards, took over, the issue has been mostly forgotten.

113038 ss dialkeys horiz 520 1 500
2006 Samsung UMPC with Dialkeys

The simplest (and arguably the most likely) solution will be for Apple to split the touch keyboard in some way. This is the same solution (DialKeys) that Microsoft adopted when they introduced their UMPC devices in 2006. Halves of the touch keyboard would sit along the left and right edges of the screen to be more accessible to your thumbs while holding the device with both hands.

A more intriguing solution, however, would be the reintroduction of handwriting recognition in at least a limited form alongside a more robust multi-touch keyboard. While much has been said of an old handwriting patent application that reemerged in November, the claims in that patent date back from Newton days and the provided image is clearly a depiction of the Newton MessagePad (image), complete with up/down arrows in the toolbar.

Instead, the most interesting multi-touch patent that has emerged from Apple in recent years is one that dates from February 2008, and describes a comprehensive multi-touch system which incorporates touch controls and proximity sensors to allow the device to handle a multitude of different input types, including stylus-less handwriting recognition:

Apparatus and methods are disclosed for simultaneously tracking multiple finger and palm contacts as hands approach, touch, and slide across a proximity-sensing, multi-touch surface. Identification and classification of intuitive hand configurations and motions enables unprecedented integration of typing, resting, pointing, scrolling, 3D manipulation, and handwriting into a versatile, ergonomic computer input device.

115703 handwriting

FingerWorks founder Wayne Westerman describes a system where the "pen grip detection module" checks to see if the hand imprint on the multi-touch screen matches up with that of holding an imaginary pen. If so, the movements are interpreted as digital ink and can be used for drawing, signatures or even handwriting recognition. This would go along nicely with Steve Jobs' dislike of styluses.

To be honest, we're not sure how such a system would work in practice, and the remainder of the patent application is likely to be more relevant to Apple's actual plans. The advanced recognition and processing involved paints a picture of an intuitive multi-touch input device that adapts to the user's intent.

Popular Stories

Delta Feature

Delta Game Emulator Now Available From App Store on iPhone

Wednesday April 17, 2024 9:58 am PDT by
Game emulator apps have come and gone since Apple announced App Store support for them on April 5, but now popular game emulator Delta from developer Riley Testut is available for download. Testut is known as the developer behind GBA4iOS, an open-source emulator that was available for a brief time more than a decade ago. GBA4iOS led to Delta, an emulator that has been available outside of...
iOS NES Emulator Bimmy Feature

NES Emulator for iPhone and iPad Now Available on App Store [Removed]

Tuesday April 16, 2024 11:33 am PDT by
The first approved Nintendo Entertainment System (NES) emulator for the iPhone and iPad was made available on the App Store today following Apple's rule change. The emulator is called Bimmy, and it was developed by Tom Salvo. On the App Store, Bimmy is described as a tool for testing and playing public domain/"homebrew" games created for the NES, but the app allows you to load ROMs for any...
iPhone 15 Pro Action Button Translate

All iPhone 16 Models to Feature Action Button, But Usefulness Debated

Tuesday April 16, 2024 6:54 am PDT by
Last September, Apple's iPhone 15 Pro models debuted with a new customizable Action button, offering faster access to a handful of functions, as well as the ability to assign Shortcuts. Apple is poised to include the feature on all upcoming iPhone 16 models, so we asked iPhone 15 Pro users what their experience has been with the additional button so far. The Action button replaces the switch ...
maxresdefault

Hands-On With the New App Store Delta Game Emulator

Wednesday April 17, 2024 12:19 pm PDT by
A decade ago, developer Riley Testut released the GBA4iOS emulator for iOS, and since it was against the rules at the time, Apple put a stop to downloads. Emulators have been a violation of the App Store rules for years, but that changed on April 5 when Apple suddenly reversed course and said that it was allowing retro game emulators on the App Store. Subscribe to the MacRumors YouTube channel ...
iOS 18 Siri Integrated Feature

iOS 18 Will Add These New Features to Your iPhone

Friday April 12, 2024 11:11 am PDT by
iOS 18 is expected to be the "biggest" update in the iPhone's history. Below, we recap rumored features and changes for the iPhone. iOS 18 is rumored to include new generative AI features for Siri and many apps, and Apple plans to add RCS support to the Messages app for an improved texting experience between iPhones and Android devices. The update is also expected to introduce a more...