Apple Pencil Used as Weight Scale, Synthesizer and 3D Image Editing Controller

by

While the Apple Pencil is designed as a sketching tool for creative professionals, MacRumors reader Simon Gladman has created three Swift demo apps that show the accessory being used for three unconventional purposes -- as a weight scale, controlled synthesizer and 3D controller for image editing.

PencilScale


PencilScale, based on Goodman's Plum-O-Meter, is an experimental app that uses a homemade harness to turn the Apple Pencil into an electronic scale that is highly sensitive, but not incredibly accurate.

The experiment works by subtracting the touch's force from a base weight, which is "set as the current touch force when the 'zero' button is pressed," and multiplying it by 140 for a very rough weight in grams.

PencilSynth


PencilSynth is an AudioKit-powered synthesizer that can be controlled by the Apple Pencil depending on its orientation and position.

  • Apple Pencil's horizontal position on the screen controls frequency

  • Apple Pencil's vertical position on the screen controls the modulating multiplier

  • Apple Pencil's altitude angle controls the carrier multiplier

  • Apple Pencil's azimuth angle controls the modulation index

PencilController


PencilController is an experimental image processing app that uses the Apple Pencil as a controller for the fine setting of parameters on Core Image filters.

The demo has three image filtering modes:

  • Hue/Saturation - Apple Pencil's azimuth angle controls hue and its altitude angle controls the saturation

  • Brightness/Contrast - Apple Pencil's altitude angle along North/South controls contrast and the angle along West/East controls brightness

  • Gamma/Exposure - Apple Pencil's altitude angle along North/South controls exposure and the angle along West/East controls gamma

Gladman explains that "the app uses a spring loaded pattern, so the user needs to hold down one of the mode keys in the bottom left of the screen to stay in the filtering mode."

The source code for all three projects is available on GitHub.

Related Roundup: iPad Pro

Top Rated Comments

(View all)
Avatar
64 months ago

I know this is sounds cool. But come on guys I'm tired of hearing this non-sense use of technology. There is abviously a much better device for such thing and it doesn't cost a lot of money to have one. I'm talking about the scale and somebody did it on iPhone 6S 3D Touch too. It's because you can it doesn't mean you have too.

Hi!

I'm actually the same guy that did the "Plum-O-Meter" for weighing things on an iPhone :)

Of course there are better devices, but I'm interested in experimenting, tinkering and playing then seeing what results. Actually, using the Pencil as a controller works really well for the fine adjustments in the image processing app and the fact the it has five degrees of freedom makes it a unique input device for the audio app.

Without some left field thinking, we'd all be using abacuses!

Cheers!

Simon
Score: 16 Votes (Like | Disagree)
Avatar
64 months ago
Aren't the phrases "Highly Sensitive" and "Not Incredibly Accurate" a bad combination under pretty much any circumstance?

.....As a side note, those two phrases remind me of almost every girlfriend I've ever had, the first phrase typically causing the second.... ;)
Score: 7 Votes (Like | Disagree)
Avatar
64 months ago

I know this is sounds cool. But come on guys I'm tired of hearing this non-sense use of technology. There is abviously a much better device for such thing and it doesn't cost a lot of money to have one. I'm talking about the scale and somebody did it on iPhone 6S 3D Touch too. It's because you can it doesn't mean you have too.

yeah, why would anyone ever want to do things?

i, for one, am witnessing exactly what i'd hope would start happening upon the release of a new device: tinkering, feedback, and constructive criticism. i'm sorry you're tired, i hear energy drinks are all the rage nowadays.
Score: 6 Votes (Like | Disagree)
Avatar
64 months ago

Aren't the phrases "Highly Sensitive" and "Not Incredibly Accurate" a bad combination under pretty much any circumstance?

Nope, from a scientific terminology perspective, that actually makes perfect sense.

Accuracy, scientifically speaking, is how close to the real value a measurement will produce.

Precision (aka sensitivity) is how small of a quantity you can measure, accurately or otherwise.

And repeatability is how close to the same value taking the same measurement at two different times will produce, accurately, precisely, or otherwise.

So: An accurate scale will tell you something weighs 502 grams when it weighs 502 grams. A precise scale will tell you that something weighs 498.93 grams, although it might actually weigh 502.00 grams if the scale is not also accurate. And a repeatable (and precise) scale will tell you that something weighs 498.93 grams every time you weigh it, although if it's not also accurate it might really weigh 502 grams.

This particular "scale", silly or otherwise, will give you a lot of digits of precision on the weight measurement, so it's quite precise. It however isn't calibrated at all, so the accuracy is bad. No idea whether it's repeatable or not.
Score: 5 Votes (Like | Disagree)
Avatar
64 months ago
Think what you could do with 3 pencils! You could control that synthesizer with one, and jam the other 2 in your ears until the racket stops.
Score: 4 Votes (Like | Disagree)
Avatar
64 months ago
I know this is sounds cool. But come on guys I'm tired of hearing this non-sense use of technology. There is abviously a much better device for such thing and it doesn't cost a lot of money to have one. I'm talking about the scale and somebody did it on iPhone 6S 3D Touch too. It's because you can it doesn't mean you have too.
Score: 3 Votes (Like | Disagree)

Top Stories

New Photos Offer Better Look at iPhone 12 Color Options

Tuesday October 20, 2020 2:34 am PDT by
As we wait for the iPhone 12 review embargo to lift later today, more pictures are circulating of the devices in real-world lighting conditions, providing a better look at the different colors available. Leaker DuanRui has shared images on Twitter of the iPhone 12 in white, black, blue, green, and (PRODUCT)RED. The black and white colors are similar to the iPhone 11 colors, but the other...

iPhone 12 Pro in Graphite and iPhone 12 in Blue Shown Off in Unboxing Videos

Monday October 19, 2020 8:20 am PDT by
While the iPhone 12 Pro does not launch until Friday, we now have an early unboxing video of the device courtesy of Twitter account DuanRui, providing a closer look at the shiny new flat-edge design and sleek Graphite color option. Ben Geskin re-uploaded the unboxing video to YouTube, which we've embedded below: Geskin has also uploaded an unboxing video of the iPhone 12 in Blue: ...

Apple Releases iPadOS and iOS 14.1 With Multiple Bug Fixes Ahead of iPhone 12 Launch

Tuesday October 20, 2020 10:06 am PDT by
Apple today released iOS and iPadOS 14.1, the first major updates to the iOS and iPadOS 14 operating system updates that were released in September. iOS and iPadOS 14.1 come a week after Apple released the golden master versions of the updates to developers. The iOS 14.1 update can be downloaded for free and it is available on all eligible devices over-the-air in the Settings app. To access...

Watch: iPhone 12 and iPhone 12 Pro Unboxing Videos and First Impressions

Tuesday October 20, 2020 6:05 am PDT by
Apple's embargo has lifted for iPhone 12 and iPhone 12 Pro reviews. In addition to our detailed review roundups for each device, we've rounded up over a dozen unboxing videos and first impressions below. iPhone 12 in Blue on left and iPhone 12 Pro in Pacific Blue on right via Engadget Key new features of the iPhone 12 and iPhone 12 Pro include a flat-edge design, 5G support, a much faster A14 ...

Gold Version of iPhone 12 Pro Apparently Has a More Fingerprint Resistant Stainless Steel Frame

Tuesday October 20, 2020 11:56 am PDT by
iPhone 12 Pro reviews hit the web today, and one of the more interesting tidbits came from TechCrunch's Matthew Panzarino, who revealed that the Gold version of the device apparently has a more fingerprint resistant coating applied to the stainless steel frame. From his review:Most of the iPhone 12 Pro finishes still use a physical vapor deposition process for edge coating. But the new gold...

Photographer Austin Mann Tests the iPhone 12 Pro's Camera

Wednesday October 21, 2020 4:14 am PDT by
Travel photographer Austin Mann usually performs an in-depth review of new iPhone models to test their camera performance in real-world scenarios. To test Apple's new iPhone 12 Pro, Mann traveled to Glacier National Park, Montana. Mann focused on some of the biggest camera upgrades with the iPhone 12 Pro, including the upgraded Wide lens, Ultra Wide Night mode, and LiDAR autofocus, across a...

iPhone 12 Pro Max Has Smaller 3,687 mAh Battery According to Regulatory Filing

Tuesday October 20, 2020 8:48 pm PDT by
Apple's new iPhone 12 Pro Max is equipped with a 3,687 mAh battery, which is around 7% less capacity than the 3,969 mAh battery in the iPhone 11 Pro Max, according to a regulatory filing published by TENAA, the Chinese equivalent of the FCC. The regulatory filing, spotted by MacRumors, also lists the iPhone 12 Pro Max with 6GB of RAM as seen in benchmark results last week. Apple has filed ...

5G Drains iPhone 12 Battery 20% Faster Than 4G in Benchmark

Wednesday October 21, 2020 3:17 am PDT by
After the first reviews for the iPhone 12 and iPhone 12 Pro emerged yesterday, a new report by Tom's Guide reveals the extent of battery life reductions when using 5G. The report outlines a test wherein the iPhone surfs the web continuously at 150 nits of screen brightness, launching a new site every 30 seconds until the battery drains. Interestingly, the test was run on an iPhone 12 and...

Hands-On With Apple's iPhone 12 and 12 Pro MagSafe Cases

Tuesday October 20, 2020 1:33 pm PDT by
Apple's iPhone 12 and 12 Pro are launching this Friday, and ahead of that release date, Apple is shipping out various accessories like the MagSafe charger and MagSafe cases. Yesterday we took a look at the MagSafe charger, and today our MagSafe case came in the mail, so we thought we'd take another look at the charger to see how it works with the case and just how strong the case magnets are. S ...

Reliable Leaker Suggests AirTags 'Coming Soon' in Two Different Sizes

Tuesday October 20, 2020 1:53 am PDT by
Apple's rumored AirTags Bluetooth tracking devices could launch imminently and will be available in two size options, based on new tweets from cryptic-but-reliable leaker L0vetodream. In typical enigmatic style, the leaker first tweeted this morning that a "big one" and a "small one" are "coming soon," but withheld what they were referring to. However that was followed an hour later with the ...