Future Apple Pencil Could Have Sensor to Sample Colors From the Real World

Apple is exploring new Apple Pencil technology that could allow the device to sample colors from the real world to use in digital art, drawings, edits, and more, according to an Apple patent application published by the United States Patent and Trademark Office this week.

Apple Pencil Color Picker
Titled "Computer System With Color Sampling Stylus," the patent describes a computer stylus that "may have a color sensor."

The color sensor would be equipped with several photodetectors able to measure light for different color channels, which would let it detect and sample a color from a real world object, like a flower.

The stylus could also be equipped with a light to make it easier for the photodetectors to accurately determine a color, and the rest of the patent describes an Apple Pencil-like design with an elongated body, a tip, and an opposing end, with the tip able to work with a touch-sensitive display.

Apple says the color sensor functionality could be located at the end of the stylus, at the tip, or coupled to the tip through a light guide.

applepatentcolorsensor
With this kind of technology, ‌Apple Pencil‌ users would be able to do something like hold the ‌Apple Pencil‌ against an object in the real world, with the ‌Apple Pencil‌ reading the color. It could be used for photorealistic paintings or just sampling of unique colors from grass, plants, existing art, and so much more.

According to the patent, the stylus would detect the color and then put it in a color palette in a drawing program, where the color could be assigned to a brush. Apple also suggests that color sensor could perhaps be used for other purposes such as calibrating displays, calibrating printers, making health-related measurements, and identifying paint colors for home projects, which would make the ‌Apple Pencil‌ even more versatile.

Optical color sensors like this already exist and have been used in various ways. In fact, we've tested a simple, rudimentary optical color sensor in the Sphero Specdrums, a product meant to turn color into sound. This product includes a little finger ring that can be tapped against real world objects to make sounds based on the color it senses, but Apple's implementation would presumably be much more precise.

Apple patents all kinds of different technologies, some of which seem plausible to implement and others that are quite fantastical. There's never any guarantee that Apple's patents will be used for real products, and in fact, most patents are for technologies that never get released.

For that reason, there's no word on whether Apple actually plans to add a color sensor to the ‌Apple Pencil‌, or if this is simply an idea that's never going to make it out of the possibilities phase.

Related Forum: iPad Accessories

Top Rated Comments

SamGabbay Avatar
35 months ago
Now that's freaking awesome.
Score: 49 Votes (Like | Disagree)
AngerDanger Avatar
35 months ago

can't wait to try it with a chameleon... ?
I can do you one better, mate…



Attachment Image
Score: 48 Votes (Like | Disagree)
UltimateSyn Avatar
35 months ago

can't wait to try it with a chameleon... ?
Error 404: Color Not Found
Score: 28 Votes (Like | Disagree)
yaxomoxay Avatar
35 months ago
can't wait to try it with a chameleon... ?
Score: 22 Votes (Like | Disagree)
nfl46 Avatar
35 months ago
I gotta admit: that’s pretty cool.
Score: 21 Votes (Like | Disagree)
Doctor Q Avatar
35 months ago
This feature could be especially helpful for color blind users like me. Since I can't identify most colors visually, I do a lot sampling/copying/pasting of colors, or looking them up and specifying them by their RGB values. Being able to grab a color and digitize it physically would be super useful.
Score: 18 Votes (Like | Disagree)

Popular Stories

iOS 16

iOS 16.4 Now Available for Your iPhone With These 8 New Features

Friday March 31, 2023 8:55 am PDT by
Following six weeks of beta testing, iOS 16.4 was released to the public this week. The software update includes a handful of new features and changes for the iPhone 8 and newer. To install an iOS update, open the Settings app on the iPhone, tap General → Software Update, and follow the on-screen instructions. Below, we have recapped eight new features and changes added with iOS 16.4,...
CarPlay Phone Call

General Motors to Phase Out Apple CarPlay Starting This Year in EV Transition

Friday March 31, 2023 8:43 am PDT by
General Motors (GM) will phase out Apple CarPlay and Android Auto in its vehicles starting this year, shifting to a built-in infotainment system co-developed with Google (via Reuters). GM owns Buick, Cadillac, Chevrolet, and GMC in the United States. It will stop offering Apple CarPlay and Android Auto starting with the 2024 Chevrolet Blazer, which goes on sale this summer. The company plans ...
iOS 17 on Phone Feature

Three New iOS Features Coming to Your iPhone Following Apple Music Classical

Thursday March 30, 2023 7:13 am PDT by
With the Apple Music Classical app and an Apple Pay Later early access program now available, the list of previously-announced iOS features that have yet to launch is beginning to shrink. However, there are still a few features we are waiting for. Below, we have recapped three more iOS features that are expected to launch in 2023, including an Apple Card savings account for Daily Cash,...
wwdc 2023

Three Products We Might See at WWDC 2023

Friday March 31, 2023 3:37 pm PDT by
Apple this week announced the official dates for the 34th annual Worldwide Developers Conference, with the annual WWDC keynote event set to take place on Monday, June 5. The keynote is where Apple unveils new versions of iOS, macOS, watchOS, and tvOS, and sometimes, we get hardware announcements. Rumors this year suggest there are at least three new devices that are set to be unveiled in the ...
iPhone 15 Pro Multi Purpose button Mute Switch Feature Green 2

iPhone 15 Pro Solid-State Button Sensitivity Can Be Customized to Cater for Cases and Gloves

Thursday March 30, 2023 11:36 pm PDT by
iPhone 15 Pro and iPhone 15 Pro Max users will be able to customize the sensitivity of the solid-state buttons on their device, thanks to a new sensitivity toggle in Settings. That's according to details provided by a hitherto reliable source that shared additional details on the MacRumors forums. Earlier this week, the same anonymous tipster revealed that the iPhone 15 Pro models will use...
apple mixed reality headset concept by david lewis and marcus kane

Kuo: Apple Mixed-Reality Headset May Not Appear at WWDC as Mass Production Pushed Back Yet Again

Thursday March 30, 2023 4:50 am PDT by
Apple has again pushed back mass production of its mixed-reality headset and the device may not appear at this year's Worldwide Developers Conference (WWDC), Apple analyst Ming-Chi Kuo today said. Apple headset concept by David Lewis and Marcus Kane In a tweet, Kuo explained that Apple "isn't very optimistic" about whether the headset will be able to create an "iPhone moment." As a result,...
iPhone 15 Pro Periscope Mock Feature

Periscope Camera Lens Exclusive to iPhone 15 Pro Max Will Be Supplied by Largan

Thursday March 30, 2023 1:18 am PDT by
The periscope camera lens that will be exclusive to the iPhone 15 Pro Max will be solely supplied by Largan, according to the 相機鏡頭中獲利-apple-camera-lens-suppliers-face-two-risks-high-53db8da990b2">latest no by Apple industry analyst Ming-Chi Kuo. Rumors about the iPhone getting a periscope lens have been circulating since early 2020, when Kuo first mentioned the possibility. The analyst...