Latest ARKit Demo Showcases Virtual Drawing

Ahead of the launch of iOS 11, developers have been tinkering with ARKit, Apple's upcoming augmented reality platform, and showcasing the myriad ways that it can be used in apps and games.

The latest demo comes courtesy of Osama Abdel-Karim, who uses ARKit to virtually paint on a notepad using his fingers.


According to Abdel-Karim, an iOS 11 library named Vision was used to develop the virtual drawing feature. Vision includes an object tracking feature that is able to detect the thumbnail of a finger and track its movement to enable the drawing.

Abdel-Karim has outlined the steps he used to create his ARKit demo and provided the full source code for the project.

When it launches this fall, ARKit is positioned to become the largest AR Platform in the world, using the camera, processors, and motion sensors in the iPhone and iPad to create some incredibly impressive augmented reality interactions.

As outlined in our video covering ARKit, the feature uses technology called Visual Inertial Odometry to track the world around an iPad or iPhone, allowing a device to sense how it moves in a room. ARKit automatically analyzes a room's layout, detecting horizontal planes like tables and floors, which then allows virtual objects to be placed upon those surfaces.


The first apps and games with ARKit won't be available until iOS 11 is officially available to the public, but we've seen what ARKit can be used for, with developers demonstrating everything from live filter applications in a recreation of A-ha's Take On Me video to live measurements of furniture and room spaces.

Check out all of our previous ARKit coverage below to see what else developers can do with it:

- ARKit Roundup: Turn-by-Turn Directions, Precise Room Measurements, and Pac-Man
- Apple's ARKit Used to Recreate Classic A-ha 'Take On Me' Video
- Apple Users' Mixed Reality Future Teased in Latest ARKit Demo
- Latest Apps to Showcase Apple's ARKit Include Simple Measuring Tape and Minecraft
- Developers Share First Augmented Reality Creations Using Apple's ARKit

Top Rated Comments

icrude Avatar
63 months ago
Really thought he was going to draw something else.
Score: 17 Votes (Like | Disagree)
jonnysods Avatar
63 months ago
This is so cool. Every time I see these demos I get excited about the possibilities.
Score: 8 Votes (Like | Disagree)
Zirel Avatar
63 months ago
“Sure Apple is behind in VR/AR, Microsoft and Google are so much advanced because they released a couple of juicy press releases and pretty demos in controlled environments.”
Score: 6 Votes (Like | Disagree)
FactVsOpinion Avatar
63 months ago
Call me a pessimist, but I just don't see any practical use in real life, nothing more than a gimmick, just like holograms when they showed them in Star Wars, 40 years later no practical use for everyday.

Don't get me wrong, nice to see companies investing in new technologies, but just because it's new and flashy, doesn't mean it's useful, and yes, like every new thing it will have a niche, but not an everyday use for regular people.
Couldn't disagree more.
[doublepost=1502306075][/doublepost]
These things make me want AR glasses again...

...Or a brain implant.
I think the lenses will certainly come. And then years later, an implant; perhaps from Musk's comapny
Score: 3 Votes (Like | Disagree)
melgross Avatar
63 months ago
It’s frustrating that Apple doesn’t have a beta section up in the App Store. In situations like this, where I run the iOS betas, I would love to have some of these AR betas on my iPad to play with, knowing, that since they are betas, that they might crash, or otherwise not function properly.
Score: 3 Votes (Like | Disagree)
naeS1Sean Avatar
63 months ago
These things make me want AR glasses again...

...Or a brain implant.
Score: 2 Votes (Like | Disagree)

Popular Stories

apple ar headset concept 1

Apple's Headset Said to Feature 14 Cameras Enabling Lifelike Avatars, Jony Ive Has Remained Involved With Design

Friday May 20, 2022 6:50 am PDT by
Earlier this week, The Information's Wayne Ma outlined struggles that Apple has faced during the development of its long-rumored AR/VR headset. Now, in a follow-up report, he has shared several additional details about the wearable device. Apple headset render created by Ian Zelbo based on The Information reporting For starters, one of the headset's marquee features is said to be lifelike...
anker 563 dock ports

Anker's Latest USB-C Docking Station Brings Triple-Display Support to M1 Macs

Wednesday May 18, 2022 7:06 am PDT by
While Apple's early M1-based Macs can only officially support a single external display, there are ways around the limitation. Anker is launching a new 10-in-1 USB-C docking station today which delivers just that. The Anker 563 USB-C dock includes two HDMI ports and a DisplayPort port, and it leverages DisplayLink to carry multiple video signals over a single connection. Given that this hub...
apple data auction iphone privacy ad

Apple Highlights iPhone's Latest Privacy Features in New 'Data Auction' Ad

Wednesday May 18, 2022 9:00 am PDT by
Apple today shared a new ad highlighting iPhone privacy features like App Tracking Transparency and Mail Privacy Protection that are designed to give users more transparency and control when it comes to their personal data being collected. The ad revolves around a young woman named Ellie who discovers that her personal data is being sold at an auction house, with bids being placed on her...
Prosser Series 8 3

Apple Watch Series 8 Rumored to Feature New Design With Flat Display

Wednesday May 18, 2022 6:21 am PDT by
The Apple Watch Series 8 could feature an all-new design with a flat display, according to the leaker known as "ShrimpApplePro." In his latest video on the YouTube channel Front Page Tech, Jon Prosser highlighted information from ShrimpApplePro that suggests the Apple Watch Series 8 could feature a flat display in what seems to be a design originally rumored for the Apple Watch Series 7. ...
sony headphones 1

Sony's New WH-1000XM5 Headphones vs. Apple's AirPods Max

Friday May 20, 2022 12:18 pm PDT by
Sony this week came out with an updated version of its popular over-ear noise canceling headphones, so we picked up a pair to compare them to the AirPods Max to see which headphones are better and whether it's worth buying the $400 WH-1000XM5 from Sony over Apple's $549 AirPods Max. Subscribe to the MacRumors YouTube channel for more videos. First of all, the AirPods Max win out when it comes ...
iPhone 14 Purple Lineup Feature

Will the iPhone 14 Be a Disappointment?

Saturday May 21, 2022 9:00 am PDT by
With around four months to go before Apple is expected to unveil the iPhone 14 lineup, the overwhelming majority of rumors related to the new devices so far have focused on the iPhone 14 Pro, rather than the standard iPhone 14 – leading to questions about how different the iPhone 14 will actually be from its predecessor, the iPhone 13. The iPhone 14 Pro and iPhone 14 Pro Max are expected...
apple ar headset concept 2

Apple's AR/VR Headset Nearing Completion as Board Gets Demo

Thursday May 19, 2022 9:52 am PDT by
Apple last week demonstrated its upcoming AR/VR headset to Apple board members, indicating that the device is in an advanced stage of development and could see a debut in the not too distant future, reports Bloomberg. Apple has also ramped up development of the software that runs on the headset, with that software expected to be called "RealityOS," or rOS for short. Render via designer Ian ...