Apple Researching Stylus Concepts with Optical Tracking and Haptic Feedback

While Steve Jobs famously panned the idea of a stylus for the iPhone at the device's unveiling in January 2007, Apple has continued researching ideas for stylus-based input, if only as part of continued reevaluation of how users interact with their devices and how technology will change those interactions over time. Toward that end, Unwired View highlights a pair of Apple patent applications filed in late 2010 and published today addressing optical and haptic stylus concepts.

Apple's idea for an optical stylus takes advantage of a tiny camera on the tip of the pen that would allow it to track patterns on a device's screen that are invisible to the user's eye. The stylus could also incorporate other sensors such as pressure sensors, accelerometers, and gyroscopes to help determine orientation and movement.

In some embodiments, a stylus is provided with an optical sensor, such as a camera, that is used in determining a location and movement of the stylus relative to a touch screen display of a computing device. It should be appreciated, however, that displays other than touch screens may be implemented in some embodiments. The optical stylus may be configured to transmit the location and movement to the computing device. In some embodiments, the optical stylus may be configured to process and/or filter the location and movement information prior to transmission, whereas in other embodiments, raw data may be transmitted.


Apple's generic iPhone stylus concept with enlarged view of encoding pattern for tracking movement

Alternatively, Apple suggests that it could incorporate haptic feedback to allow users to gain a tactile feel for the content on a device's screen via a stylus. Apple has researched haptics for quite some time, and the patent application published today describes how a haptic actuator embedded in the stylus could receive signals from a device to help users gain a tactile feel for the context of their onscreen input.

Generally, input devices do not provide haptic feedback to a user in response to interactions with the input device. The user can typically only feel the rigid surface of the touch screen, making it difficult to find icons, hyperlinks, text boxes, or other user-selectable input elements on the display. An input device capable of generating haptic feedback may help a user navigate content displayed on the display screen, and may further serve to enhance the content of various applications by creating a more appealing and realistic user interface. "Haptic feedback" may be any tactile feedback. Examples include forces, vibrations, and/or motions that may be sensed by the user.


Apple's concept for stylus with haptic feedback

There has been essentially no evidence that Apple is seriously looking at incorporating a stylus into its products, but it remains clear that the company is thinking about how such pen-based input could be used in novel ways.

Tag: patent

Top Rated Comments

(View all)
Avatar
110 months ago

Research it all you want, please don't implement it.

Why not exactly?

If Apple wants to move everyone towards tablets and touchscreens then they will need a stylus. Just like the massive number of professionals Wacom has catered to for decades.

Ah, wait, I said professionals. Silly me.
Score: 36 Votes (Like | Disagree)
Avatar
110 months ago

The best stylus is your finger.

Yes i have to agree with you. However using your finger is not as accurate as a stylus imo. :)
Score: 36 Votes (Like | Disagree)
Avatar
110 months ago

The best stylus is your finger.

Going to disagree here. Do you think the best pen is your finger dabbed in ink? If I want to write on a digital screen (no doubt this is where technology will take us), I want an accurate stylus that mimics a pen as close as possible. However, I don't get all this haptic feedback BS. If you're going the stylus route (as a very useful accessory) then focus on the pen-like experience, please, Apple!
Score: 26 Votes (Like | Disagree)
Avatar
110 months ago
Please Apple bring on an option for a Stylus !

This can't happen a minute to soon.

Using your finger is like finger painting for a professional artist or designer. Graphics without a Wacom tablet is like gong back to kindergarden.

I am sure that Apple's patents are a way to get around all of Wacom's tablet patents.
Score: 25 Votes (Like | Disagree)
Avatar
110 months ago

The best stylus is your finger.


This is kind of like saying the best cutlery is your hands. Sure they're okay for eating sandwiches etc. but you wouldn't want to use them to tuck into a risotto or a steak.
Score: 23 Votes (Like | Disagree)
Avatar
110 months ago

If you see a stylus, they blew it.


Steve said a lot of things and then proceeded to do the exact opposite. I always find it funny when people quote him like it was gospel.
Score: 15 Votes (Like | Disagree)

Top Stories

Apple References Unreleased 2020 16-Inch MacBook Pro in Boot Camp Update

Monday October 26, 2020 8:42 am PDT by
Last week, Apple released an update for Boot Camp, its utility for running Windows on a Mac. While this update would typically be unremarkable, several of our readers noticed that the release notes reference an unreleased 2020 model of the 16-inch MacBook Pro. While this could easily be a mistake, the 16-inch MacBook Pro is nearly a year old, so it is certainly a worthy candidate for a...

MagSafe Charger Only Charges at Full 15W Speeds With Apple's 20W Power Adapter [Updated]

Monday October 26, 2020 3:38 pm PDT by
Alongside the iPhone 12 and 12 Pro models, Apple introduced a new MagSafe charger that attaches to the magnetic ring in the back of the devices, providing up to 15W of charging power, which is double the speed of the 7.5W Qi-based wireless charging maximum. Apple does not provide a power adapter with the $39 MagSafe charger, requiring users to supply their own USB-C compatible option. Apple...

Google Reportedly Pays Apple $8-12 Billion Per Year to be Default iOS Search Engine

Sunday October 25, 2020 2:59 pm PDT by
The United States Justice Department is targeting a lucrative deal between Apple and Google as part of one of the U.S. government's largest antitrust cases, reports The New York Times. On Tuesday, the Justice Department filed an antitrust lawsuit against Google, claiming the Mountain View-based company used anticompetitive and exclusionary practices in the search and advertising markets to ...

After Mocking Apple, Samsung May Remove Power Adapter From Galaxy S21 Box

Tuesday October 27, 2020 4:29 pm PDT by
Samsung's Galaxy S21, coming in 2021, may not include a power adapter or headphones in the box, according to reports from Korean media sites highlighted by SamMobile. Rumors earlier this year also said that Samsung was considering removing these accessories from future smartphone models, but that didn't stop Samsung from mocking Apple for selling the iPhone 12 models without a power adapter...

Report: Apple Silicon iMac Featuring Desktop Class 'A14T' Chip Coming First Half of 2021

Tuesday October 27, 2020 4:14 am PDT by
The first iMac powered by Apple Silicon is set to arrive in the first half of next year and will feature a desktop class "A14T" chip, according to Chinese-language newspaper The China Times. Codenamed "Mt. Jade," Apple's first custom-made desktop processor will be twinned with its first self-developed GPU, codenamed "Lifuka," both of which are being produced using TSMC's 5-nanometer process, ...

iPhone 12 Six-Foot Drop Test Results: Ceramic Shield More Durable But Not Damage Proof

Monday October 26, 2020 5:00 am PDT by
Apple's new iPhone 12 and iPhone 12 Pro feature a new Ceramic Shield screen that Apple says offers 4x better drop performance. To test that claim, Allstate Protection Plans put the two models through a range of breakability tests and recorded the results. In a face down sidewalk drop test at six feet, the iPhone 12 suffered small cracks and scuffed corners and edges, leaving sharp grooves in ...

Bloomberg: New AirPods and AirPods Pro Coming in 2021, AirPods Studio Delayed, Third HomePod Model Also Possible

Monday October 26, 2020 3:34 am PDT by
Apple plans to update its AirPods line next year with two new models including third-generation AirPods and second-generation AirPods Pro, according to a new report from Bloomberg. The Cupertino, California-based technology giant is working on two new models: third-generation entry-level AirPods and the second version of the AirPods Pro earbuds, according to people familiar with the plans. ...

2020 iPad Air vs. iPad Pro: Hands-On Comparison

Tuesday October 27, 2020 3:03 pm PDT by
Apple announced the new 2020 fourth-generation iPad Air in September, but the new tablets just started shipping out to customers last Friday. We picked one up and thought we'd do a hands-on comparison with the iPad Pro, which was last updated in March, because both tablets are about as powerful and share many similarities. Subscribe to the MacRumors YouTube channel for more videos. Design and ...

iPhone 12 Ceramic Shield Still 'Scratches at Level 6 With Deeper Grooves at Level 7' in Mohs Hardness Test

Wednesday October 28, 2020 7:10 am PDT by
iPhone 12 and iPhone 12 Pro models feature a new Ceramic Shield front cover that is "tougher than any smartphone glass," according to Apple, but the displays on the devices still have similar scratch resistance as previous iPhones based on a new test. Zack Nelson today shared his much-anticipated iPhone 12 Pro durability test on his YouTube channel JerryRigEverything, and based on the Mohs...

Apple Files Mystery 'Personal Computer' With Placeholder 'B2002' Name in Bluetooth Product Database

Tuesday October 27, 2020 12:36 pm PDT by
Last week, a listing appeared in the Bluetooth product database for an Apple product with a placeholder name "B2002" and a model number of "TBD." MacRumors was alerted to the listing by health and fitness tech website MyHealthyApple. The product is filed under the "personal computer" category, which Apple has used for previous Mac and iPad listings in the database, so it is hard to pinpoint...