Apple Pencil Used as Weight Scale, Synthesizer and 3D Image Editing Controller - MacRumors
Skip to Content

Apple Pencil Used as Weight Scale, Synthesizer and 3D Image Editing Controller

by

While the Apple Pencil is designed as a sketching tool for creative professionals, MacRumors reader Simon Gladman has created three Swift demo apps that show the accessory being used for three unconventional purposes -- as a weight scale, controlled synthesizer and 3D controller for image editing.

PencilScale


PencilScale, based on Goodman's Plum-O-Meter, is an experimental app that uses a homemade harness to turn the Apple Pencil into an electronic scale that is highly sensitive, but not incredibly accurate.

The experiment works by subtracting the touch's force from a base weight, which is "set as the current touch force when the 'zero' button is pressed," and multiplying it by 140 for a very rough weight in grams.

PencilSynth


PencilSynth is an AudioKit-powered synthesizer that can be controlled by the Apple Pencil depending on its orientation and position.

  • Apple Pencil's horizontal position on the screen controls frequency

  • Apple Pencil's vertical position on the screen controls the modulating multiplier

  • Apple Pencil's altitude angle controls the carrier multiplier

  • Apple Pencil's azimuth angle controls the modulation index

PencilController


PencilController is an experimental image processing app that uses the Apple Pencil as a controller for the fine setting of parameters on Core Image filters.

The demo has three image filtering modes:

  • Hue/Saturation - Apple Pencil's azimuth angle controls hue and its altitude angle controls the saturation

  • Brightness/Contrast - Apple Pencil's altitude angle along North/South controls contrast and the angle along West/East controls brightness

  • Gamma/Exposure - Apple Pencil's altitude angle along North/South controls exposure and the angle along West/East controls gamma

Gladman explains that "the app uses a spring loaded pattern, so the user needs to hold down one of the mode keys in the bottom left of the screen to stay in the filtering mode."

The source code for all three projects is available on GitHub.

Related Roundup: iPad Pro
Buyer's Guide: iPad Pro (Caution)
Related Forum: iPad Accessories

Top Rated Comments

FlexMonkey Avatar
143 months ago
I know this is sounds cool. But come on guys I'm tired of hearing this non-sense use of technology. There is abviously a much better device for such thing and it doesn't cost a lot of money to have one. I'm talking about the scale and somebody did it on iPhone 6S 3D Touch too. It's because you can it doesn't mean you have too.
Hi!

I'm actually the same guy that did the "Plum-O-Meter" for weighing things on an iPhone :)

Of course there are better devices, but I'm interested in experimenting, tinkering and playing then seeing what results. Actually, using the Pencil as a controller works really well for the fine adjustments in the image processing app and the fact the it has five degrees of freedom makes it a unique input device for the audio app.

Without some left field thinking, we'd all be using abacuses!

Cheers!

Simon
Score: 16 Votes (Like | Disagree)
143 months ago
Aren't the phrases "Highly Sensitive" and "Not Incredibly Accurate" a bad combination under pretty much any circumstance?

.....As a side note, those two phrases remind me of almost every girlfriend I've ever had, the first phrase typically causing the second.... ;)
Score: 7 Votes (Like | Disagree)
teslo Avatar
143 months ago
I know this is sounds cool. But come on guys I'm tired of hearing this non-sense use of technology. There is abviously a much better device for such thing and it doesn't cost a lot of money to have one. I'm talking about the scale and somebody did it on iPhone 6S 3D Touch too. It's because you can it doesn't mean you have too.
yeah, why would anyone ever want to do things?

i, for one, am witnessing exactly what i'd hope would start happening upon the release of a new device: tinkering, feedback, and constructive criticism. i'm sorry you're tired, i hear energy drinks are all the rage nowadays.
Score: 6 Votes (Like | Disagree)
143 months ago
Aren't the phrases "Highly Sensitive" and "Not Incredibly Accurate" a bad combination under pretty much any circumstance?
Nope, from a scientific terminology perspective, that actually makes perfect sense.

Accuracy, scientifically speaking, is how close to the real value a measurement will produce.

Precision (aka sensitivity) is how small of a quantity you can measure, accurately or otherwise.

And repeatability is how close to the same value taking the same measurement at two different times will produce, accurately, precisely, or otherwise.

So: An accurate scale will tell you something weighs 502 grams when it weighs 502 grams. A precise scale will tell you that something weighs 498.93 grams, although it might actually weigh 502.00 grams if the scale is not also accurate. And a repeatable (and precise) scale will tell you that something weighs 498.93 grams every time you weigh it, although if it's not also accurate it might really weigh 502 grams.

This particular "scale", silly or otherwise, will give you a lot of digits of precision on the weight measurement, so it's quite precise. It however isn't calibrated at all, so the accuracy is bad. No idea whether it's repeatable or not.
Score: 5 Votes (Like | Disagree)
nagromme Avatar
143 months ago
Think what you could do with 3 pencils! You could control that synthesizer with one, and jam the other 2 in your ears until the racket stops.
Score: 4 Votes (Like | Disagree)
garirry Avatar
143 months ago
I know this is sounds cool. But come on guys I'm tired of hearing this non-sense use of technology. There is abviously a much better device for such thing and it doesn't cost a lot of money to have one. I'm talking about the scale and somebody did it on iPhone 6S 3D Touch too. It's because you can it doesn't mean you have too.
Jesus ****ing christ, it's called EXPERIMENTATION. People EXPERIMENT with various devices and tools to create fun stuff. Maybe in real life it's incredibly pointless (there are better devices/software for cheap), but from a pure technical standpoint, it's very interesting.
Score: 3 Votes (Like | Disagree)

Popular Stories

iPad Pro 2024 vs Air 2024 Feature

Three New iPads Rumored to Launch in First Half of 2027

Sunday November 1, 2026 7:27 am PST by
After announcing a new iPad mini with an OLED display earlier this month, Apple plans to release new iPad Air, iPad Pro, and entry-level iPad models in the first half of 2027, according to the latest word from Bloomberg's Mark Gurman. In his Power On newsletter today, Gurman said the next iPad Air will also feature an OLED display, while he expects the next iPad Pro to be equipped with a...
iPad mini 7 Review Thumb 1 sans text

Apple Raises iPad and Mac Trade-In Values

Monday October 26, 2026 8:17 am PDT by
Apple today updated its U.S. trade-in estimates, raising maximum values across the iPad lineup and for most Macs following today's announcement of the new iPad mini. Every iPad category has gained value, although the increases are relatively modest. The iPad mini and standard iPad both rise by $20, while the iPad Air gains $15 and the iPad Pro increases by $10. The revised maximum estimates...
iPhone Duo Apple Pencil Useful Thumb

Using an Apple Pencil With the iPhone Duo: What to Know

Friday October 23, 2026 1:49 pm PDT by
The iPhone Duo is compatible with the Apple Pencil, if you have the right one. MacRumors videographer Dan Barbera tested the Apple Pencil with the iPhone Duo to see if it's a useful tool to pick up. If you already have an Apple Pencil 1, Apple Pencil 2, or Apple Pencil Pro to use with an iPad, you're going to be disappointed to hear they won't work with the iPhone Duo. The iPhone Duo only...
Latest Stories
Everything New in the iOS 27.3 Beta
Everything New in the iOS 27.3 Beta
9 hours ago
Apple Music's New Selfie Sing Feature Lets You Record Karaoke Videos
Apple Music's New Selfie Sing Feature Lets You Record Karaoke Videos
9 hours ago
iPhone Jailbreak Gets Past Lockdown Mode and Survives an Update
iPhone Jailbreak Gets Past Lockdown Mode and Survives an Update
11 hours ago
iPadOS 27.3 Expands Siri Mode to Camera App
iPadOS 27.3 Expands Siri Mode to Camera App
13 hours ago
Veterans Day Apple Watch Activity Challenge Launches November 11
Veterans Day Apple Watch Activity Challenge Launches November 11
13 hours ago
Best Early Black Friday Mac Deals: Save Hundreds on MacBook Air, Mac Mini, and More
Best Early Black Friday Mac Deals: Save Hundreds on MacBook Air, Mac Mini, and More
14 hours ago
Apple Fitness+ Gets Gym Strength Plans in iOS 27.3
Apple Fitness+ Gets Gym Strength Plans in iOS 27.3
14 hours ago
iOS 27.3 Adding New StandBy Mode Features to iPhone 11 and Newer
iOS 27.3 Adding New StandBy Mode Features to iPhone 11 and Newer
14 hours ago
Apple Releases New AirPods Beta Firmware
Apple Releases New AirPods Beta Firmware
14 hours ago
iOS 27.3 Beta Brings Apple Intelligence to China
iOS 27.3 Beta Brings Apple Intelligence to China
14 hours ago
iPhone Duo Gets Reachability in iOS 27.3 Beta
iPhone Duo Gets Reachability in iOS 27.3 Beta
14 hours ago
Siri AI Gets More Capable in iOS 27.3
Siri AI Gets More Capable in iOS 27.3
14 hours ago
iOS 27.3 Adds Vertical Tabs and Adaptive Dark Mode to Safari
iOS 27.3 Adds Vertical Tabs and Adaptive Dark Mode to Safari
15 hours ago
watchOS 27.3 Brings Live Rewind and Siri Recap to Apple Watch
watchOS 27.3 Brings Live Rewind and Siri Recap to Apple Watch
15 hours ago
iOS 27.3 Beta Brings Back Apple's Redesigned Health App
iOS 27.3 Beta Brings Back Apple's Redesigned Health App
15 hours ago
Apple Releases First macOS Golden Gate 27.3 Beta
Apple Releases First macOS Golden Gate 27.3 Beta
15 hours ago
Apple Seeds First iOS 27.3 Beta
Apple Seeds First iOS 27.3 Beta
15 hours ago
Apple Releases First watchOS 27.3, tvOS 27.3 and visionOS 27.3 Betas
Apple Releases First watchOS 27.3, tvOS 27.3 and visionOS 27.3 Betas
15 hours ago
iPad Mini 8 Reviewer Dissatisfied With Apple's Excuse for Lack of 120Hz Display
iPad Mini 8 Reviewer Dissatisfied With Apple's Excuse for Lack of 120Hz Display
15 hours ago
iPad Mini 8 Review Claims Battery Life is Way Better Than Apple Says
iPad Mini 8 Review Claims Battery Life is Way Better Than Apple Says
16 hours ago
B&H Photo Launches Early Black Friday Sale With Discounts on Macs and Accessories
B&H Photo Launches Early Black Friday Sale With Discounts on Macs and Accessories
16 hours ago
iPhone Duo Could Take Nearly 30% of Foldable Market in 2027
iPhone Duo Could Take Nearly 30% of Foldable Market in 2027
17 hours ago
Apple Watch Automatically Identifies Songs Playing Around You
Apple Watch Automatically Identifies Songs Playing Around You
17 hours ago
iPhone 18 Rumored to Get Larger Battery and Potential Price Increase
iPhone 18 Rumored to Get Larger Battery and Potential Price Increase
18 hours ago
Apple Store in UK Permanently Closing Later This Month
Apple Store in UK Permanently Closing Later This Month
18 hours ago
Apple's Annual R&D Spending Jumps by More Than $11 Billion
Apple's Annual R&D Spending Jumps by More Than $11 Billion
19 hours ago
Will Apple Ever Merge iPadOS and macOS? John Ternus Responds
Will Apple Ever Merge iPadOS and macOS? John Ternus Responds
19 hours ago
MacBook Neo Gets Rare $30 Amazon Discount
MacBook Neo Gets Rare $30 Amazon Discount
19 hours ago
Hands-On: The OLED iPad Mini is Almost an iPad Pro Mini
Hands-On: The OLED iPad Mini is Almost an iPad Pro Mini
19 hours ago
tvOS 27.2.1 and macOS 27.2.1 Likely Coming Soon
tvOS 27.2.1 and macOS 27.2.1 Likely Coming Soon
20 hours ago