Apple Researching Stylus Concepts with Optical Tracking and Haptic Feedback

While Steve Jobs famously panned the idea of a stylus for the iPhone at the device's unveiling in January 2007, Apple has continued researching ideas for stylus-based input, if only as part of continued reevaluation of how users interact with their devices and how technology will change those interactions over time. Toward that end, Unwired View highlights a pair of Apple patent applications filed in late 2010 and published today addressing optical and haptic stylus concepts.

Apple's idea for an optical stylus takes advantage of a tiny camera on the tip of the pen that would allow it to track patterns on a device's screen that are invisible to the user's eye. The stylus could also incorporate other sensors such as pressure sensors, accelerometers, and gyroscopes to help determine orientation and movement.

In some embodiments, a stylus is provided with an optical sensor, such as a camera, that is used in determining a location and movement of the stylus relative to a touch screen display of a computing device. It should be appreciated, however, that displays other than touch screens may be implemented in some embodiments. The optical stylus may be configured to transmit the location and movement to the computing device. In some embodiments, the optical stylus may be configured to process and/or filter the location and movement information prior to transmission, whereas in other embodiments, raw data may be transmitted.

apple optical stylus patent
Apple's generic iPhone stylus concept with enlarged view of encoding pattern for tracking movement

Alternatively, Apple suggests that it could incorporate haptic feedback to allow users to gain a tactile feel for the content on a device's screen via a stylus. Apple has researched haptics for quite some time, and the patent application published today describes how a haptic actuator embedded in the stylus could receive signals from a device to help users gain a tactile feel for the context of their onscreen input.

Generally, input devices do not provide haptic feedback to a user in response to interactions with the input device. The user can typically only feel the rigid surface of the touch screen, making it difficult to find icons, hyperlinks, text boxes, or other user-selectable input elements on the display. An input device capable of generating haptic feedback may help a user navigate content displayed on the display screen, and may further serve to enhance the content of various applications by creating a more appealing and realistic user interface. "Haptic feedback" may be any tactile feedback. Examples include forces, vibrations, and/or motions that may be sensed by the user.

apple haptic stylus
Apple's concept for stylus with haptic feedback

There has been essentially no evidence that Apple is seriously looking at incorporating a stylus into its products, but it remains clear that the company is thinking about how such pen-based input could be used in novel ways.

Tag: patent

Top Rated Comments

ArcaneDevice Avatar
115 months ago
Research it all you want, please don't implement it.
Why not exactly?

If Apple wants to move everyone towards tablets and touchscreens then they will need a stylus. Just like the massive number of professionals Wacom has catered to for decades.

Ah, wait, I said professionals. Silly me.
Score: 36 Votes (Like | Disagree)
jasonxneo Avatar
115 months ago
The best stylus is your finger.
Yes i have to agree with you. However using your finger is not as accurate as a stylus imo. :)
Score: 36 Votes (Like | Disagree)
Dangerous Theory Avatar
115 months ago
The best stylus is your finger.
Going to disagree here. Do you think the best pen is your finger dabbed in ink? If I want to write on a digital screen (no doubt this is where technology will take us), I want an accurate stylus that mimics a pen as close as possible. However, I don't get all this haptic feedback BS. If you're going the stylus route (as a very useful accessory) then focus on the pen-like experience, please, Apple!
Score: 26 Votes (Like | Disagree)
mrr Avatar
115 months ago
Please Apple bring on an option for a Stylus !

This can't happen a minute to soon.

Using your finger is like finger painting for a professional artist or designer. Graphics without a Wacom tablet is like gong back to kindergarden.

I am sure that Apple's patents are a way to get around all of Wacom's tablet patents.
Score: 25 Votes (Like | Disagree)
Padraig Avatar
115 months ago
The best stylus is your finger.

This is kind of like saying the best cutlery is your hands. Sure they're okay for eating sandwiches etc. but you wouldn't want to use them to tuck into a risotto or a steak.
Score: 23 Votes (Like | Disagree)
Padraig Avatar
115 months ago
If you see a stylus, they blew it.

Steve said a lot of things and then proceeded to do the exact opposite. I always find it funny when people quote him like it was gospel.
Score: 15 Votes (Like | Disagree)

Top Stories

apple transfer google photos 1

Apple Launches Service for Transferring iCloud Photos and Videos to Google Photos

Wednesday March 3, 2021 12:04 pm PST by
Apple this week introduced a new service that's designed to make it quick and easy for iCloud users to transfer their stored photos and videos to Google Photos. As outlined in an Apple support document, you can go to Apple's privacy website and sign in to see the "Transfer a copy of your data" option. If you select this and go through all the steps, Apple will transfer your iCloud photos and ...
PIA23764 RoverNamePlateonMars web

NASA Mars Perseverance Rover Uses Same PowerPC Chipset Found in 1998 G3 iMac

Tuesday March 2, 2021 3:21 am PST by
NASA's Perseverance rover, which recently made history landing on the surface of Mars, is powered by the same processor used in an iMac more than 23 years old. Image Credit: NASA As reported by NewScientist (via Gizmodo), the rover includes the PowerPC 750 processor, the same chip used in the G3 iMac in 1998. The main chipset is the same; however, there are differences between the...
rosetta 2

Rosetta May Be Removed From M1 Macs in Some Regions on macOS 11.3

Tuesday March 2, 2021 5:20 pm PST by
Installing the upcoming macOS 11.3 software update on an M1 Mac may result in Rosetta 2 being removed in one or more regions around the world. In the third beta of macOS 11.3 seeded to developers for testing today, MacRumors contributor Steve Moser uncovered new strings in the beta's code indicating that "Rosetta will be removed upon installing this update." Another new string reads "Rosetta ...
iphone 6 in hand

Apple Faces Another iPhone Lawsuit Over 'Programmed Obsolescence'

Monday March 1, 2021 6:44 am PST by
Apple faces a new class-action lawsuit that accuses it of deliberately releasing iOS updates that slowly reduce the performance of an iPhone, forcing customers to upgrade their devices. The lawsuit comes from the Portuguese Consumer Protection Agency, Deco Proteste (via Marketeer), which in a statement says that it will proceed with a case against the Cupertino tech giant because it...
magsafe charging brick feature

Prosser: iPhone 12 MagSafe Battery Pack to Feature Reverse Charging

Monday March 1, 2021 1:18 pm PST by
Apple is working on MagSafe-compatible battery packs that will be compatible with the iPhone 12 models, and leaker Jon Prosser today said on the Genius Bar podcast that one version of the battery pack will feature "reverse charging." According to Prosser, Apple is working on two versions of the battery packs, one that's a standard version and one that's a premium version with reverse...
Screen Shot 2021 03 03 at 11

MagSafe Charging Port for iPhone Appears in Apple Patent

Wednesday March 3, 2021 1:30 am PST by
In a newly granted patent, Apple envisions a type of connectivity port using an iteration of its magnetic MagSafe charger to charge an iPhone, potentially paving the way for a future without Lightning. Submitted to the United States Patent and Trademark Office on Tuesday (via Patently Apple), the patent outlines a three-pinned MagSafe charger, similar to the ones found in older MacBook...
Apple Prefer Lightning Over USB C Feature

iPhone Sticking With Lightning Port Over USB-C for 'Foreseeable Future'

Tuesday March 2, 2021 9:32 am PST by
Apple will retain the Lightning connector on the iPhone for the "foreseeable future," with no intention of switching to USB-C, according to reliable analyst Ming-Chi Kuo. In spite of much of the industry moving toward USB-C, Apple will not be using it to replace the Lightning connector on the iPhone 13, or indeed on any iPhone model for the time being. In a note seen by MacRumors yesterday,...
iPad mini pro feature

Sketchy Rumor Claims 'iPad Mini Pro' Launching in Second Half of 2021

Wednesday March 3, 2021 3:04 am PST by
Apple is expected to launch a sixth-generation iPad mini in the first half of 2021, possibly as soon as this March, based on long-standing rumors. However, a new rumor out of Asia that has gained traction in the last 24 hours suggests an "iPad mini Pro" will arrive in the second half of this year. According to a post on Korean blog Naver, whose rumor track record is unknown, the device...
apple pencil 3 leak

New Apple Pencil Allegedly Leaks With Glossy Finish and Redesigned Tip

Wednesday March 3, 2021 6:17 am PST by
Images supposedly depicting a third-generation Apple Pencil have been shared on Twitter by the leaker known as "Mr. White." The purported new Apple Pencil appears to share a very similar design to the current, second-generation Apple Pencil, which is shorter than the previous version and charges inductively on the side of an iPad. The updated Apple Pencil appears to have a glossy...
apple watch ecg wrist

Apple Watch ECG Feature Gets Approved in Australia

Wednesday March 3, 2021 2:07 am PST by
The Australian government has approved ECG functionality on the Apple Watch, giving Apple the all-clear to launch the feature for Apple Watch users in the country, according to a regulatory document first spotted by The 8-Bit. Earlier last month, the Apple Watch's irregular heart rhythm notification received approval in Australia, although ECG did not. Irregular heart rhythm is a feature...