Apple Researching Stylus Concepts with Optical Tracking and Haptic Feedback

While Steve Jobs famously panned the idea of a stylus for the iPhone at the device's unveiling in January 2007, Apple has continued researching ideas for stylus-based input, if only as part of continued reevaluation of how users interact with their devices and how technology will change those interactions over time. Toward that end, Unwired View highlights a pair of Apple patent applications filed in late 2010 and published today addressing optical and haptic stylus concepts.

Apple's idea for an optical stylus takes advantage of a tiny camera on the tip of the pen that would allow it to track patterns on a device's screen that are invisible to the user's eye. The stylus could also incorporate other sensors such as pressure sensors, accelerometers, and gyroscopes to help determine orientation and movement.

In some embodiments, a stylus is provided with an optical sensor, such as a camera, that is used in determining a location and movement of the stylus relative to a touch screen display of a computing device. It should be appreciated, however, that displays other than touch screens may be implemented in some embodiments. The optical stylus may be configured to transmit the location and movement to the computing device. In some embodiments, the optical stylus may be configured to process and/or filter the location and movement information prior to transmission, whereas in other embodiments, raw data may be transmitted.


Apple's generic iPhone stylus concept with enlarged view of encoding pattern for tracking movement

Alternatively, Apple suggests that it could incorporate haptic feedback to allow users to gain a tactile feel for the content on a device's screen via a stylus. Apple has researched haptics for quite some time, and the patent application published today describes how a haptic actuator embedded in the stylus could receive signals from a device to help users gain a tactile feel for the context of their onscreen input.

Generally, input devices do not provide haptic feedback to a user in response to interactions with the input device. The user can typically only feel the rigid surface of the touch screen, making it difficult to find icons, hyperlinks, text boxes, or other user-selectable input elements on the display. An input device capable of generating haptic feedback may help a user navigate content displayed on the display screen, and may further serve to enhance the content of various applications by creating a more appealing and realistic user interface. "Haptic feedback" may be any tactile feedback. Examples include forces, vibrations, and/or motions that may be sensed by the user.


Apple's concept for stylus with haptic feedback

There has been essentially no evidence that Apple is seriously looking at incorporating a stylus into its products, but it remains clear that the company is thinking about how such pen-based input could be used in novel ways.

Tag: patent

Top Rated Comments

(View all)
Avatar
107 months ago

Research it all you want, please don't implement it.

Why not exactly?

If Apple wants to move everyone towards tablets and touchscreens then they will need a stylus. Just like the massive number of professionals Wacom has catered to for decades.

Ah, wait, I said professionals. Silly me.
Score: 36 Votes (Like | Disagree)
Avatar
107 months ago

The best stylus is your finger.

Yes i have to agree with you. However using your finger is not as accurate as a stylus imo. :)
Score: 36 Votes (Like | Disagree)
Avatar
107 months ago

The best stylus is your finger.

Going to disagree here. Do you think the best pen is your finger dabbed in ink? If I want to write on a digital screen (no doubt this is where technology will take us), I want an accurate stylus that mimics a pen as close as possible. However, I don't get all this haptic feedback BS. If you're going the stylus route (as a very useful accessory) then focus on the pen-like experience, please, Apple!
Score: 26 Votes (Like | Disagree)
Avatar
107 months ago
Please Apple bring on an option for a Stylus !

This can't happen a minute to soon.

Using your finger is like finger painting for a professional artist or designer. Graphics without a Wacom tablet is like gong back to kindergarden.

I am sure that Apple's patents are a way to get around all of Wacom's tablet patents.
Score: 25 Votes (Like | Disagree)
Avatar
107 months ago

The best stylus is your finger.


This is kind of like saying the best cutlery is your hands. Sure they're okay for eating sandwiches etc. but you wouldn't want to use them to tuck into a risotto or a steak.
Score: 23 Votes (Like | Disagree)
Avatar
107 months ago

If you see a stylus, they blew it.


Steve said a lot of things and then proceeded to do the exact opposite. I always find it funny when people quote him like it was gospel.
Score: 15 Votes (Like | Disagree)

Top Stories

Apple Announces New 27-Inch iMac With 10th-Gen Processors, Up to 128GB RAM, 1080p Webcam, True Tone, and More

Tuesday August 4, 2020 8:07 am PDT by
Apple today announced a new 27-inch iMac with faster 10th-generation Intel Core processor options, next-generation AMD graphics, up to 128GB of RAM, a higher-resolution 1080p front-facing FaceTime camera, a True Tone display with a nano-texture glass option, a T2 chip, higher fidelity speakers, studio-quality microphones, and more. A breakdown of the new 27-inch iMac's features and specs:10th...

8 Third-Party Home Screen Widgets That You Can Try Out Now on iOS 14

Wednesday August 5, 2020 12:56 pm PDT by
One of the biggest new features of iOS 14 is Home Screen widgets, which provide information from apps at a glance. The widgets can be pinned to the Home Screen in various spots and sizes, allowing for many different layouts. When the iOS 14 beta was first released in June, widgets were limited to Apple's own apps like Calendar and Weather, but several third-party developers have begun to test ...

Everything New in iOS 14 Beta 4: Apple TV Widget, Search Improvements, Exposure Notification API and More

Tuesday August 4, 2020 11:14 am PDT by
Apple today released the fourth developer betas of iOS and iPadOS 14 for testing purposes, tweaking and refining some of the features and design changes included in the update. Changes get smaller and less notable as the beta testing period goes on, but there are still some noteworthy new features in the fourth beta, which we've highlighted below. - Apple TV widget - There's a new Apple TV...

Apple May Launch This Year's 'iPhone 12' Lineup in Two Stages, With 6.1-inch Models Debuting First

Monday August 3, 2020 3:14 am PDT by
Apple last week confirmed that its "‌iPhone‌ 12" launch will be delayed this year due to the ongoing global health crisis and restrictions on travel. Apple last year started selling iPhones in late September, but this year, Apple projects supply will be "available a few weeks later," suggesting a release sometime in October. We're expecting a total of four OLED iPhones in 5.4, 6.1, and...

Apple Explains Why You Might See 'Not Charging' When a Mac is Plugged In

Monday August 3, 2020 1:42 pm PDT by
If you have a Mac and have seen a "Not Charging" warning when plugging it in to power, Apple last week released a support document that explains why. Macs running macOS 10.15.5 or later have a Battery Health Management feature to preserve the life of the battery, and occasionally, the Battery Health Management option will cause the Mac to pause its charging for calibration purposes.Depending ...

Supposed iPhone 12 Display Unit Leaks

Thursday August 6, 2020 8:13 am PDT by
An image supposedly of an iPhone 12 display unit has been shared online by leaker "Twitter user Mr. White". Compared to images of an iPhone 11 Pro display piece, this new unit has a reoriented display connector, reaching up from the bottom of the display, rather than from the left-hand side on iPhone 11 Pro. This may be due to the logic board moving to the other side of the device. A...

Google's $349 Pixel 4a vs. Apple's $399 iPhone SE

Wednesday August 5, 2020 1:45 pm PDT by
Google this week launched its newest smartphone, the $349 Pixel 4a, a low-cost device that's designed to compete with other affordable devices like Apple's iPhone SE. We picked up one of the new Pixel 4a smartphones and thought we'd check it out to see how it measures up to the iPhone SE, given that the two devices have such similar price points. Subscribe to the MacRumors YouTube channel ...

Apple-Acquired Dark Sky Officially Shuts Down Android App

Saturday August 1, 2020 3:43 pm PDT by
Apple in March purchased weather app Dark Sky, and at that time, Dark Sky's developers said that the app's Android version would be discontinued on July 1, 2020. However, instead of shuttering the app on that date, the app's developers announced that the discontinuation would be delayed for another month. Now that it's August, Android users are no longer able to access the app, and...

Samsung Launches Galaxy Note 20, Galaxy Z Fold 2, and Galaxy Buds to Compete With Apple's iPhones and AirPods Pro

Wednesday August 5, 2020 10:07 am PDT by
Samsung today held a virtual Galaxy Unpacked event where it unveiled its next-generation smartphones that will compete with Apple's 2020 iPhone lineup, set to come out in the fall. Samsung announced the launch of the Galaxy Note 20 and the Galaxy Note 20 Ultra, the two newest devices in the Note lineup, and, more notably, the Galaxy Z Fold 2, Samsung's latest foldable smartphone. The...

Alleged 'iPhone 12' Images Depict Circular Array of Magnets in Chassis

Wednesday August 5, 2020 4:39 am PDT by
New images shared on Weibo appear to show a circular array of magnets housed inside an "iPhone 12" chassis. The unverified images depict 36 individual magnets in a circular arrangement, suggesting they could be related to mounting or charging. EverythingApplePro, who shared the Weibo-originating images on Twitter, also posted an image of an alleged iPhone 12 case with a similar array of...