Apple Pencil Used as Weight Scale, Synthesizer and 3D Image Editing Controller

by

While the Apple Pencil is designed as a sketching tool for creative professionals, MacRumors reader Simon Gladman has created three Swift demo apps that show the accessory being used for three unconventional purposes -- as a weight scale, controlled synthesizer and 3D controller for image editing.

PencilScale


PencilScale, based on Goodman's Plum-O-Meter, is an experimental app that uses a homemade harness to turn the Apple Pencil into an electronic scale that is highly sensitive, but not incredibly accurate.

The experiment works by subtracting the touch's force from a base weight, which is "set as the current touch force when the 'zero' button is pressed," and multiplying it by 140 for a very rough weight in grams.

PencilSynth


PencilSynth is an AudioKit-powered synthesizer that can be controlled by the Apple Pencil depending on its orientation and position.

  • Apple Pencil's horizontal position on the screen controls frequency

  • Apple Pencil's vertical position on the screen controls the modulating multiplier

  • Apple Pencil's altitude angle controls the carrier multiplier

  • Apple Pencil's azimuth angle controls the modulation index

PencilController


PencilController is an experimental image processing app that uses the Apple Pencil as a controller for the fine setting of parameters on Core Image filters.

The demo has three image filtering modes:

  • Hue/Saturation - Apple Pencil's azimuth angle controls hue and its altitude angle controls the saturation

  • Brightness/Contrast - Apple Pencil's altitude angle along North/South controls contrast and the angle along West/East controls brightness

  • Gamma/Exposure - Apple Pencil's altitude angle along North/South controls exposure and the angle along West/East controls gamma

Gladman explains that "the app uses a spring loaded pattern, so the user needs to hold down one of the mode keys in the bottom left of the screen to stay in the filtering mode."

The source code for all three projects is available on GitHub.

Related Roundup: iPad Pro

Top Rated Comments

FlexMonkey Avatar
68 months ago

I know this is sounds cool. But come on guys I'm tired of hearing this non-sense use of technology. There is abviously a much better device for such thing and it doesn't cost a lot of money to have one. I'm talking about the scale and somebody did it on iPhone 6S 3D Touch too. It's because you can it doesn't mean you have too.

Hi!

I'm actually the same guy that did the "Plum-O-Meter" for weighing things on an iPhone :)

Of course there are better devices, but I'm interested in experimenting, tinkering and playing then seeing what results. Actually, using the Pencil as a controller works really well for the fine adjustments in the image processing app and the fact the it has five degrees of freedom makes it a unique input device for the audio app.

Without some left field thinking, we'd all be using abacuses!

Cheers!

Simon
Score: 16 Votes (Like | Disagree)
Waxhead138 Avatar
68 months ago
Aren't the phrases "Highly Sensitive" and "Not Incredibly Accurate" a bad combination under pretty much any circumstance?

.....As a side note, those two phrases remind me of almost every girlfriend I've ever had, the first phrase typically causing the second.... ;)
Score: 7 Votes (Like | Disagree)
teslo Avatar
68 months ago

I know this is sounds cool. But come on guys I'm tired of hearing this non-sense use of technology. There is abviously a much better device for such thing and it doesn't cost a lot of money to have one. I'm talking about the scale and somebody did it on iPhone 6S 3D Touch too. It's because you can it doesn't mean you have too.

yeah, why would anyone ever want to do things?

i, for one, am witnessing exactly what i'd hope would start happening upon the release of a new device: tinkering, feedback, and constructive criticism. i'm sorry you're tired, i hear energy drinks are all the rage nowadays.
Score: 6 Votes (Like | Disagree)
Makosuke Avatar
68 months ago

Aren't the phrases "Highly Sensitive" and "Not Incredibly Accurate" a bad combination under pretty much any circumstance?

Nope, from a scientific terminology perspective, that actually makes perfect sense.

Accuracy, scientifically speaking, is how close to the real value a measurement will produce.

Precision (aka sensitivity) is how small of a quantity you can measure, accurately or otherwise.

And repeatability is how close to the same value taking the same measurement at two different times will produce, accurately, precisely, or otherwise.

So: An accurate scale will tell you something weighs 502 grams when it weighs 502 grams. A precise scale will tell you that something weighs 498.93 grams, although it might actually weigh 502.00 grams if the scale is not also accurate. And a repeatable (and precise) scale will tell you that something weighs 498.93 grams every time you weigh it, although if it's not also accurate it might really weigh 502 grams.

This particular "scale", silly or otherwise, will give you a lot of digits of precision on the weight measurement, so it's quite precise. It however isn't calibrated at all, so the accuracy is bad. No idea whether it's repeatable or not.
Score: 5 Votes (Like | Disagree)
nagromme Avatar
68 months ago
Think what you could do with 3 pencils! You could control that synthesizer with one, and jam the other 2 in your ears until the racket stops.
Score: 4 Votes (Like | Disagree)
joueboy Avatar
68 months ago
I know this is sounds cool. But come on guys I'm tired of hearing this non-sense use of technology. There is abviously a much better device for such thing and it doesn't cost a lot of money to have one. I'm talking about the scale and somebody did it on iPhone 6S 3D Touch too. It's because you can it doesn't mean you have too.
Score: 3 Votes (Like | Disagree)

Top Stories

magsafecasedangle

Apple Elaborates on Potential for iPhone 12 and MagSafe Accessories to Interfere With Implantable Medical Devices

Saturday January 23, 2021 2:42 pm PST by
Since the launch of iPhone 12 models in October, Apple has acknowledged that the devices may cause electromagnetic interference with medical devices like pacemakers and defibrillators, but the company has now shared additional information. Apple added the following paragraph to a related support document today:Medical devices such as implanted pacemakers and defibrillators might contain...
Top Stories 44 Feature

Top Stories: 'Thinner and Lighter' MacBook Air, Smaller iPhone 13 Notch, iOS 14.4 Incoming

Saturday January 23, 2021 6:00 am PST by
We continued to hear a lot more about Apple's plans for its Mac lineup this week, including word of a high-end redesigned MacBook Air and the return of an SD card slot as part of the upcoming MacBook Pro redesign. It also sounds like Apple has been working on Face ID for Mac, but it won't be appearing in a redesigned iMac this year as originally planned. This week also saw rumors about the...
bloodoxygenapplewatch

Apple Watch Series 7 Rumored to Feature Blood Glucose Monitoring

Monday January 25, 2021 5:05 am PST by
The Apple Watch Series 7 will reportedly feature blood glucose monitoring via an optical sensor, according to ETNews. The report, which mainly focuses on the blood glucose capabilities of the Samsung Galaxy Watch 4, explains that Apple is intending to bring blood glucose monitoring to the upcoming Apple Watch Series 7 using a non-invasive optical sensor. Measuring blood glucose levels,...
maxresdefault

Microsoft Touts Surface Pro 7 as 'The Better Choice' Over MacBook Pro in New Ad

Saturday January 23, 2021 11:02 am PST by
Microsoft yesterday shared a new ad on YouTube titled "Microsoft Surface Pro 7: The Better Choice," in which the company compares its tablet computer to Apple's 13-inch M1 MacBook Pro, as spotted by MSPoweruser. The ad highlights the Surface Pro 7's touchscreen and included stylus as opposed to only a "little bar" (the Touch Bar) on the MacBook Pro. Other advantages of the Surface Pro 7...
airpods galaxy buds comparison

Samsung Galaxy Buds Pro vs. Apple AirPods Pro

Friday January 22, 2021 2:34 pm PST by
Samsung in January unveiled new flagship Galaxy S21 smartphones and alongside the new phones, introduced the $200 Galaxy Buds Pro, which are priced at $199 and offer Active Noise Cancellation. Subscribe to the MacRumors YouTube channel for more videos. These new Galaxy Buds Pro are clearly designed to compete with Apple's AirPods Pro, so we thought we'd compare the two sets of earbuds in our...
2021 mbp sd slot feature2

Bloomberg: Next MacBook Pro to Feature SD Card Reader

Friday January 22, 2021 7:50 am PST by
Last week, reputable analyst Ming-Chi Kuo outlined his expectations for new 14-inch and 16-inch MacBook Pro models later this year, including the return of the MagSafe charging connector, the removal of the Touch Bar, a new flat-edged design, and the return of more ports built into the notebooks for expanded connectivity. A concept of a modern MacBook Pro with an SD card reader Kuo did not...
time to walk apple watch

Apple Fitness+ Feature 'Time to Walk' Launching Soon With Audio Stories From Special Guests

Saturday January 23, 2021 7:13 pm PST by
Earlier this week, Apple seeded the watchOS 7.3 Release Candidate, which is typically the final beta version of a software update. The release notes for the update list a new "Time to Walk" feature for Apple Fitness+ subscribers, described as "an audio experience in the Workout app where guests share inspiring stories as you walk." Apple Fitness+ subscribers will be able to open the Workout...
Flat MacBook Air Feature

Bloomberg: Apple Working on 'Thinner and Lighter' High-End MacBook Air With MagSafe, Could Launch in Second Half of 2021

Friday January 22, 2021 3:34 am PST by
Apple is working on a "thinner and lighter" version of the MacBook Air that the company plans to release during the second half of this year at the earliest or in 2022, according to a new report by well-connected Bloomberg journalist Mark Gurman. It will include Apple's MagSafe charging technology and a next-generation version of the company's in-house Mac processors. Apple has discussed...
q4 2020 mac growth feature

Mac Sales Skyrocketing After M1 Launch

Tuesday January 19, 2021 3:00 am PST by
Apple's worldwide Mac shipments grew massively in the fourth quarter of 2020 after the launch of three new Macs with the M1 chip, according to new PC shipping estimates shared by Gartner. Apple shipped an estimated 6.9 million Macs, up from the 5.25 million it shipped at the same time in 2019, marking significant growth of 31.3 percent. In spite of the growth of Mac sales, Apple remained...
apple time to walk apple watch airpods 01252021 inline

Apple's New 'Time to Walk' Feature Launches Today for Fitness+ Subscribers

Monday January 25, 2021 6:30 am PST by
Apple today officially introduced Time to Walk, a new feature for Apple Fitness+ subscribers with audio stories from influential people that Apple Watch users can listen to with AirPods or other wireless headphones while walking. Time to Walk episodes will be automatically downloaded to the Apple Watch with a Fitness+ subscription, and users can start an episode directly from the Workout...