While the Apple Pencil is designed as a sketching tool for creative professionals, MacRumors reader Simon Gladman has created three Swift demo apps that show the accessory being used for three unconventional purposes -- as a weight scale, controlled synthesizer and 3D controller for image editing.

PencilScale


PencilScale, based on Goodman's Plum-O-Meter, is an experimental app that uses a homemade harness to turn the Apple Pencil into an electronic scale that is highly sensitive, but not incredibly accurate.

The experiment works by subtracting the touch's force from a base weight, which is "set as the current touch force when the 'zero' button is pressed," and multiplying it by 140 for a very rough weight in grams.

PencilSynth


PencilSynth is an AudioKit-powered synthesizer that can be controlled by the Apple Pencil depending on its orientation and position.

  • Apple Pencil's horizontal position on the screen controls frequency

  • Apple Pencil's vertical position on the screen controls the modulating multiplier

  • Apple Pencil's altitude angle controls the carrier multiplier

  • Apple Pencil's azimuth angle controls the modulation index

PencilController


PencilController is an experimental image processing app that uses the Apple Pencil as a controller for the fine setting of parameters on Core Image filters.

The demo has three image filtering modes:

  • Hue/Saturation - Apple Pencil's azimuth angle controls hue and its altitude angle controls the saturation

  • Brightness/Contrast - Apple Pencil's altitude angle along North/South controls contrast and the angle along West/East controls brightness

  • Gamma/Exposure - Apple Pencil's altitude angle along North/South controls exposure and the angle along West/East controls gamma

Gladman explains that "the app uses a spring loaded pattern, so the user needs to hold down one of the mode keys in the bottom left of the screen to stay in the filtering mode."

The source code for all three projects is available on GitHub.

Related Roundup: iPad Pro
Buyer's Guide: iPad Pro (Buy Now)
Related Forum: iPad Accessories

Top Rated Comments

FlexMonkey Avatar
130 months ago
I know this is sounds cool. But come on guys I'm tired of hearing this non-sense use of technology. There is abviously a much better device for such thing and it doesn't cost a lot of money to have one. I'm talking about the scale and somebody did it on iPhone 6S 3D Touch too. It's because you can it doesn't mean you have too.
Hi!

I'm actually the same guy that did the "Plum-O-Meter" for weighing things on an iPhone :)

Of course there are better devices, but I'm interested in experimenting, tinkering and playing then seeing what results. Actually, using the Pencil as a controller works really well for the fine adjustments in the image processing app and the fact the it has five degrees of freedom makes it a unique input device for the audio app.

Without some left field thinking, we'd all be using abacuses!

Cheers!

Simon
Score: 16 Votes (Like | Disagree)
Waxhead138 Avatar
130 months ago
Aren't the phrases "Highly Sensitive" and "Not Incredibly Accurate" a bad combination under pretty much any circumstance?

.....As a side note, those two phrases remind me of almost every girlfriend I've ever had, the first phrase typically causing the second.... ;)
Score: 7 Votes (Like | Disagree)
teslo Avatar
130 months ago
I know this is sounds cool. But come on guys I'm tired of hearing this non-sense use of technology. There is abviously a much better device for such thing and it doesn't cost a lot of money to have one. I'm talking about the scale and somebody did it on iPhone 6S 3D Touch too. It's because you can it doesn't mean you have too.
yeah, why would anyone ever want to do things?

i, for one, am witnessing exactly what i'd hope would start happening upon the release of a new device: tinkering, feedback, and constructive criticism. i'm sorry you're tired, i hear energy drinks are all the rage nowadays.
Score: 6 Votes (Like | Disagree)
Makosuke Avatar
130 months ago
Aren't the phrases "Highly Sensitive" and "Not Incredibly Accurate" a bad combination under pretty much any circumstance?
Nope, from a scientific terminology perspective, that actually makes perfect sense.

Accuracy, scientifically speaking, is how close to the real value a measurement will produce.

Precision (aka sensitivity) is how small of a quantity you can measure, accurately or otherwise.

And repeatability is how close to the same value taking the same measurement at two different times will produce, accurately, precisely, or otherwise.

So: An accurate scale will tell you something weighs 502 grams when it weighs 502 grams. A precise scale will tell you that something weighs 498.93 grams, although it might actually weigh 502.00 grams if the scale is not also accurate. And a repeatable (and precise) scale will tell you that something weighs 498.93 grams every time you weigh it, although if it's not also accurate it might really weigh 502 grams.

This particular "scale", silly or otherwise, will give you a lot of digits of precision on the weight measurement, so it's quite precise. It however isn't calibrated at all, so the accuracy is bad. No idea whether it's repeatable or not.
Score: 5 Votes (Like | Disagree)
nagromme Avatar
130 months ago
Think what you could do with 3 pencils! You could control that synthesizer with one, and jam the other 2 in your ears until the racket stops.
Score: 4 Votes (Like | Disagree)
joueboy Avatar
130 months ago
I know this is sounds cool. But come on guys I'm tired of hearing this non-sense use of technology. There is abviously a much better device for such thing and it doesn't cost a lot of money to have one. I'm talking about the scale and somebody did it on iPhone 6S 3D Touch too. It's because you can it doesn't mean you have too.
Score: 3 Votes (Like | Disagree)

Popular Stories

m1 chip slide

Five Years of Apple Silicon: M1 to M5 Performance Comparison

Monday November 10, 2025 1:08 pm PST by
Today marks the fifth anniversary of the Apple silicon chip that replaced Intel chips in Apple's Mac lineup. The first Apple silicon chip, the M1, was unveiled on November 10, 2020. The M1 debuted in the MacBook Air, Mac mini, and 13-inch MacBook Pro. The M1 chip was impressive when it launched, featuring the "world's fastest CPU core" and industry-leading performance per watt, and it's only ...
iOS 26

iOS 26.2 Available Next Month With These 8 New Features

Tuesday November 11, 2025 9:48 am PST by
Apple released the first iOS 26.2 beta last week. The upcoming update includes a handful of new features and changes on the iPhone, including a new Liquid Glass slider for the Lock Screen's clock, offline lyrics in Apple Music, and more. In a recent press release, Apple confirmed that iOS 26.2 will be released to all users in December, but it did not provide a specific release date....
All Screen iPhone 2027 Feature 1

Apple to Hide Selfie Camera Under Display of 20th Anniversary iPhone

Monday November 10, 2025 1:55 am PST by
Apple will conceal the front-facing camera under the screen of its 2027 iPhone, a Chinese leaker said today, corroborating reports that Apple's 20th anniversary iPhone will have no visible cutouts in the display. Weibo-based account Digital Chat Station said Apple's development of under-screen camera technology was progressing as planned for adoption in 2027, one year after it will...
iphone pocket%402x

Apple Debuts iPhone Pocket, a Limited Edition iPod Sock-Style Accessory

Tuesday November 11, 2025 1:23 am PST by
Apple has teamed up with Japanese fashion house ISSEY MIYAKE to launch iPhone Pocket, a 3D-knitted limited edition accessory designed to carry an iPhone, AirPods, and other everyday items. The accessory is like a stretchy pocket, not unlike an iPod Sock, but elongated to form a strap made of a ribbed, elastic textile that fully encloses an iPhone yet allows you to glimpse the display...
iphone air thinness

iPhone Air Sales Are So Bad That Apple's Delaying the Next-Generation Version

Monday November 10, 2025 11:41 am PST by
The thin, light iPhone Air sold so poorly that Apple has decided to delay the launch of the next-generation iPhone Air that was scheduled to come out alongside the iPhone 18 Pro, reports The Information. Apple initially planned to release a new iPhone Air in fall 2026, but now that's not going to happen. Since the iPhone Air launched in September, there have been reports of poor sales...
homepod mini colors

New HomePod Mini Coming Soon With These Features

Tuesday November 11, 2025 7:30 am PST by
Apple is expected to announce a new HomePod mini imminently, headlining with new chips. Here are all of the new features we're expecting. The second-generation HomePod mini is highly likely to contain a more up-to-date chip for more advanced computational audio and improved responsiveness. The current HomePod mini is equipped with the Apple Watch Series 5's S5 chip from 2019. Apple is likely ...
ios 26 digital id passport wallet

Apple Announces Launch of U.S. Passport Feature in iPhone's Wallet App

Wednesday November 12, 2025 9:15 am PST by
Apple today announced that iPhone users can now create a Digital ID in the Apple Wallet app based on information from their U.S. passport. To create and present a Digital ID based on a U.S. passport, you need: An iPhone 11 or later running iOS 26.1 or later, or an Apple Watch Series 6 or later running watchOS 26.1 or later Face ID or Touch ID and Bluetooth turned on An Apple Account ...
iphone black friday gold

The Best Early Black Friday iPhone Deals

Monday November 10, 2025 10:18 am PST by
Cellular carriers have always offered big savings on the newest iPhone models during the holidays, and Black Friday 2025 sales have kicked off at AT&T, Verizon, T-Mobile, and more. Right now we're tracking notable offers on the iPhone 17, iPhone 17 Pro, iPhone 17 Pro Max, and iPhone Air. For even more savings, keep an eye on older models during the holiday shopping season. Note: MacRumors is...
homepod mini thumb feature

New HomePod Mini, Apple TV, and AirTag Were Expected This Year — Where Are They?

Wednesday November 12, 2025 11:42 am PST by
While it was rumored that Apple planned to release new versions of the HomePod mini, Apple TV, and AirTag this year, it is no longer clear if that will still happen. Back in January, Bloomberg's Mark Gurman said Apple planned to release new HomePod mini and Apple TV models "toward the end of the year," while he at one point expected a new AirTag to launch "around the middle of 2025." Yet,...
Early Black Friday Deals 1

The Best Early Black Friday Apple Deals on AirPods, Apple Watch, iPad, and More

Saturday November 8, 2025 6:16 am PST by
We're officially in the month of Black Friday, which will take place on Friday, November 28 in 2025. As always, this will be the best time of the year to shop for great deals, including popular Apple products like AirPods, iPad, Apple Watch, and more. In this article, the majority of the discounts will be found on Amazon. Note: MacRumors is an affiliate partner with some of these vendors. When ...