Future Apple Pencil Could Have Sensor to Sample Colors From the Real World

Apple is exploring new Apple Pencil technology that could allow the device to sample colors from the real world to use in digital art, drawings, edits, and more, according to an Apple patent application published by the United States Patent and Trademark Office this week.


Titled "Computer System With Color Sampling Stylus," the patent describes a computer stylus that "may have a color sensor."

The color sensor would be equipped with several photodetectors able to measure light for different color channels, which would let it detect and sample a color from a real world object, like a flower.

The stylus could also be equipped with a light to make it easier for the photodetectors to accurately determine a color, and the rest of the patent describes an Apple Pencil-like design with an elongated body, a tip, and an opposing end, with the tip able to work with a touch-sensitive display.

Apple says the color sensor functionality could be located at the end of the stylus, at the tip, or coupled to the tip through a light guide.


With this kind of technology, ‌Apple Pencil‌ users would be able to do something like hold the ‌Apple Pencil‌ against an object in the real world, with the ‌Apple Pencil‌ reading the color. It could be used for photorealistic paintings or just sampling of unique colors from grass, plants, existing art, and so much more.

According to the patent, the stylus would detect the color and then put it in a color palette in a drawing program, where the color could be assigned to a brush. Apple also suggests that color sensor could perhaps be used for other purposes such as calibrating displays, calibrating printers, making health-related measurements, and identifying paint colors for home projects, which would make the ‌Apple Pencil‌ even more versatile.

Optical color sensors like this already exist and have been used in various ways. In fact, we've tested a simple, rudimentary optical color sensor in the Sphero Specdrums, a product meant to turn color into sound. This product includes a little finger ring that can be tapped against real world objects to make sounds based on the color it senses, but Apple's implementation would presumably be much more precise.

Apple patents all kinds of different technologies, some of which seem plausible to implement and others that are quite fantastical. There's never any guarantee that Apple's patents will be used for real products, and in fact, most patents are for technologies that never get released.

For that reason, there's no word on whether Apple actually plans to add a color sensor to the ‌Apple Pencil‌, or if this is simply an idea that's never going to make it out of the possibilities phase.

Top Rated Comments

(View all)
Avatar
3 weeks ago
Now that's freaking awesome.
Score: 49 Votes (Like | Disagree)
Avatar
3 weeks ago


can't wait to try it with a chameleon... ?

I can do you one better, mate…



Score: 48 Votes (Like | Disagree)
Avatar
3 weeks ago


can't wait to try it with a chameleon... ?

Error 404: Color Not Found
Score: 28 Votes (Like | Disagree)
Avatar
3 weeks ago
can't wait to try it with a chameleon... ?
Score: 22 Votes (Like | Disagree)
Avatar
3 weeks ago
I gotta admit: that’s pretty cool.
Score: 21 Votes (Like | Disagree)
Avatar
3 weeks ago
This feature could be especially helpful for color blind users like me. Since I can't identify most colors visually, I do a lot sampling/copying/pasting of colors, or looking them up and specifying them by their RGB values. Being able to grab a color and digitize it physically would be super useful.
Score: 18 Votes (Like | Disagree)

Top Stories

Apple-Acquired Dark Sky Officially Shuts Down Android App

Saturday August 1, 2020 3:43 pm PDT by
Apple in March purchased weather app Dark Sky, and at that time, Dark Sky's developers said that the app's Android version would be discontinued on July 1, 2020. However, instead of shuttering the app on that date, the app's developers announced that the discontinuation would be delayed for another month. Now that it's August, Android users are no longer able to access the app, and...

Apple May Launch This Year's 'iPhone 12' Lineup in Two Stages, With 6.1-inch Models Debuting First

Monday August 3, 2020 3:14 am PDT by
Apple last week confirmed that its "‌iPhone‌ 12" launch will be delayed this year due to the ongoing global health crisis and restrictions on travel. Apple last year started selling iPhones in late September, but this year, Apple projects supply will be "available a few weeks later," suggesting a release sometime in October. We're expecting a total of four OLED iPhones in 5.4, 6.1, and...

Top Stories: Try the 5.4-Inch iPhone 12 Display Size, Blockbuster Earnings, Tim Cook at Antitrust Hearing

Saturday August 1, 2020 6:00 am PDT by
Another busy week of Apple news and rumors has wrapped up, with a lot of focus on Tim Cook's appearance at a Congressional antitrust hearing and a blockbuster earnings report. Subscribe to the MacRumors YouTube channel for more videos. We continued to hear rumors about the upcoming iPhone 12 lineup, including a rare admission from Apple that the lineup will launch "a few weeks later" than...

Just How Small Will the 5.4-Inch iPhone 12 Screen Be? Try It Out for Yourself

Tuesday July 28, 2020 12:57 pm PDT by
As rumors of the iPhone 12 have continued to build over the past few months, the one model that has the most excitement around it is the smallest 5.4" model. The iPhone 12 is believed to be coming in 5.4", 6.7", and 6.1" sizes. Dummy models have shown how much smaller the 5.4" is compared to the rest of the iPhone lineup. The upcoming 5.4" iPhone falls in-between the size of the original...

Unreleased iPod Touch with Mac Pro Glossy Black Finish Shared Online

Sunday August 2, 2020 11:32 am PDT by
Twitter user @DongleBookPro has today posted images of what seems to be a first-generation iPod Touch prototype with a 2013 Mac Pro-style glossy black finish. The Twitter user claims that the iPod Touch prototype pictured has "the same coating as the 2013 Mac Pro." Had the finish been selected for the final product, it also would have been similar to the metallic glossy black finish that...

Apple Confirms This Year's iPhone 12 Models Will Be a Little Bit Late

Thursday July 30, 2020 2:34 pm PDT by
During today's earnings call covering the third fiscal quarter of 2020 (second calendar quarter) Apple CFO Luca Maestri confirmed that Apple is expecting to release this year's iPhones later than usual. Maestri said that Apple last year started selling iPhones in late September, but this year, Apple projects supply will be "available a few weeks later." Multiple rumors have suggested that ...

Battery Likely for Upcoming Apple Watch Series 6 Filed in Certification Listings

Saturday August 1, 2020 5:46 am PDT by
A battery likely for the upcoming Apple Watch Series 6 has been filed at the Korea Testing and Research Institute and discovered by a Twitter user @yabhishekhd. Certification for a 1.17Wh battery with a capacity of 303.8mAh was issued on June 23 by the KTR, a Korean regulatory body that approves and tests new hardware ahead of public sale. The battery seems to be destined for a future...

Apple Watch Series 6 to Feature Blood Oxygen Monitoring Sensor

Friday July 31, 2020 1:56 am PDT by
The Apple Watch Series 6 will add blood oxygen monitoring to its features list when it's launched later this year, according to a new report from DigiTimes. Apple Watch 6 will feature biosensors that can monitor sleeping conditions, detect blood oxygen and measure pulse rates, heartbeats and atrial fibrillation, and will also incorporate MEMS-based accelerometer and gyroscope, all allowing the ...

Apple Marks Return of NHL With New 'Hockey Tape' Ad Shot on iPhone 11 Pro

Saturday August 1, 2020 2:33 am PDT by
Apple today marked the return of NHL hockey with a new "Shot on iPhone" ad on its YouTube channel in Canada. Titled "Hockey Tape," the 30-second video features Vegas Golden Knights players Marc-André Fleury and Mark Stone having some on-ice fun with the iPhone 11 Pro, which they attach to the boards, a hockey stick, and a skate with hockey tape. "See the game like never before with Ultra ...

Emails Reveal Why Steve Jobs and Phil Schiller Blocked In-App Purchase of Kindle Books

Friday July 31, 2020 6:25 am PDT by
Internal Apple emails, made public by the House Judiciary Committee's antitrust inquiry, have revealed information about why Apple blocked in-app purchases of Kindle books on iOS devices, reports The Verge. Two sets of emails between Steve Jobs, Phil Schiller, Eddy Cue, and various other senior Apple executives, disclose the exact thinking behind how Apple approached Kindle on iOS. The...