Future Apple Pencil Could Have Sensor to Sample Colors From the Real World

Apple is exploring new Apple Pencil technology that could allow the device to sample colors from the real world to use in digital art, drawings, edits, and more, according to an Apple patent application published by the United States Patent and Trademark Office this week.

Apple Pencil Color Picker
Titled "Computer System With Color Sampling Stylus," the patent describes a computer stylus that "may have a color sensor."

The color sensor would be equipped with several photodetectors able to measure light for different color channels, which would let it detect and sample a color from a real world object, like a flower.

The stylus could also be equipped with a light to make it easier for the photodetectors to accurately determine a color, and the rest of the patent describes an Apple Pencil-like design with an elongated body, a tip, and an opposing end, with the tip able to work with a touch-sensitive display.

Apple says the color sensor functionality could be located at the end of the stylus, at the tip, or coupled to the tip through a light guide.

applepatentcolorsensor
With this kind of technology, ‌Apple Pencil‌ users would be able to do something like hold the ‌Apple Pencil‌ against an object in the real world, with the ‌Apple Pencil‌ reading the color. It could be used for photorealistic paintings or just sampling of unique colors from grass, plants, existing art, and so much more.

According to the patent, the stylus would detect the color and then put it in a color palette in a drawing program, where the color could be assigned to a brush. Apple also suggests that color sensor could perhaps be used for other purposes such as calibrating displays, calibrating printers, making health-related measurements, and identifying paint colors for home projects, which would make the ‌Apple Pencil‌ even more versatile.

Optical color sensors like this already exist and have been used in various ways. In fact, we've tested a simple, rudimentary optical color sensor in the Sphero Specdrums, a product meant to turn color into sound. This product includes a little finger ring that can be tapped against real world objects to make sounds based on the color it senses, but Apple's implementation would presumably be much more precise.

Apple patents all kinds of different technologies, some of which seem plausible to implement and others that are quite fantastical. There's never any guarantee that Apple's patents will be used for real products, and in fact, most patents are for technologies that never get released.

For that reason, there's no word on whether Apple actually plans to add a color sensor to the ‌Apple Pencil‌, or if this is simply an idea that's never going to make it out of the possibilities phase.

Related Forum: iPad Accessories

Top Rated Comments

SamGabbay Avatar
50 months ago
Now that's freaking awesome.
Score: 49 Votes (Like | Disagree)
AngerDanger Avatar
50 months ago

can't wait to try it with a chameleon... ?
I can do you one better, mate…



Attachment Image
Score: 48 Votes (Like | Disagree)
UltimateSyn Avatar
50 months ago

can't wait to try it with a chameleon... ?
Error 404: Color Not Found
Score: 28 Votes (Like | Disagree)
yaxomoxay Avatar
50 months ago
can't wait to try it with a chameleon... ?
Score: 22 Votes (Like | Disagree)
nfl46 Avatar
50 months ago
I gotta admit: that’s pretty cool.
Score: 21 Votes (Like | Disagree)
Doctor Q Avatar
50 months ago
This feature could be especially helpful for color blind users like me. Since I can't identify most colors visually, I do a lot sampling/copying/pasting of colors, or looking them up and specifying them by their RGB values. Being able to grab a color and digitize it physically would be super useful.
Score: 18 Votes (Like | Disagree)

Popular Stories

iOS 18 Apple Music Messages and Notes Feature 1

iOS 18 Rumored to Add New Features to These 16 Apps on Your iPhone

Tuesday April 30, 2024 10:44 am PDT by
Apple is expected to announce iOS 18 during its WWDC keynote on June 10, and new features have already been rumored for many apps, including Apple Music, Apple Maps, Calculator, Messages, Notes, Safari, and others. Below, we recap iOS 18 rumors on a per-app basis, based on reports from MacRumors, Bloomberg's Mark Gurman, and others: Apple Maps: At least two new Apple Maps features are...
apple watch ipad demo 1

Check Out This Apple Watch iPad Demo Unit From 2014

Wednesday May 1, 2024 1:46 pm PDT by
With the 10th anniversary of the Apple Watch approaching, we thought it would be fun to take a look back at an interesting bit of Apple Watch history. After the Apple Watch was announced in 2014, and before it became available in 2015, Apple sent out custom Apple Watch iPad demo kiosks to retail stores. The Apple Watch and iPad units used for these devices were specially designed, had custom ...
Apple Event Let Loose Pastel Green

Report: Five Things Apple Won't Announce at Its Event Next Week

Friday May 3, 2024 4:30 am PDT by
Apple is holding at least five announcements for later in the year that will not arrive at the company's "Let loose" special event next week, according to Bloomberg's Mark Gurman. In a report detailing his expectations for Apple's upcoming event, Gurman noted that there are a total of five things that the company is holding for later in the year: AI features: While Apple may tease new...
Apple Silicon AI Optimized Feature Siri 1

Tim Cook on Generative AI: 'We Have Advantages That Will Differentiate Us'

Thursday May 2, 2024 2:11 pm PDT by
During today's earnings call covering the second fiscal quarter of 2024, Apple CEO Tim Cook again spoke about Apple's work on generative AI. He said that Apple has "advantages" that will "differentiate" the company in the era of AI, and some "very exciting things" will be shared with customers in the near future. We continue to feel very bullish about our opportunity in generative AI. We are ...
maxresdefault

Will the New iPad Pro Really Have the M4 Chip?

Wednesday May 1, 2024 8:30 am PDT by
While Apple's upcoming iPad Pro models have been expected to feature the M3 chip for over a year, recent reports have unexpectedly suggested that the new devices will instead feature the as-yet-unannounced M4 chip. Subscribe to the MacRumors YouTube channel for more videos. Last week, Bloomberg's Mark Gurman said that he now believes there is a "strong possibility" that the upcoming iPad Pro ...