Latest ARKit Demo Showcases Virtual Drawing

Ahead of the launch of iOS 11, developers have been tinkering with ARKit, Apple's upcoming augmented reality platform, and showcasing the myriad ways that it can be used in apps and games.

The latest demo comes courtesy of Osama Abdel-Karim, who uses ARKit to virtually paint on a notepad using his fingers.


According to Abdel-Karim, an iOS 11 library named Vision was used to develop the virtual drawing feature. Vision includes an object tracking feature that is able to detect the thumbnail of a finger and track its movement to enable the drawing.

Abdel-Karim has outlined the steps he used to create his ARKit demo and provided the full source code for the project.

When it launches this fall, ARKit is positioned to become the largest AR Platform in the world, using the camera, processors, and motion sensors in the iPhone and iPad to create some incredibly impressive augmented reality interactions.

As outlined in our video covering ARKit, the feature uses technology called Visual Inertial Odometry to track the world around an iPad or iPhone, allowing a device to sense how it moves in a room. ARKit automatically analyzes a room's layout, detecting horizontal planes like tables and floors, which then allows virtual objects to be placed upon those surfaces.


The first apps and games with ARKit won't be available until iOS 11 is officially available to the public, but we've seen what ARKit can be used for, with developers demonstrating everything from live filter applications in a recreation of A-ha's Take On Me video to live measurements of furniture and room spaces.

Check out all of our previous ARKit coverage below to see what else developers can do with it:

- ARKit Roundup: Turn-by-Turn Directions, Precise Room Measurements, and Pac-Man
- Apple's ARKit Used to Recreate Classic A-ha 'Take On Me' Video
- Apple Users' Mixed Reality Future Teased in Latest ARKit Demo
- Latest Apps to Showcase Apple's ARKit Include Simple Measuring Tape and Minecraft
- Developers Share First Augmented Reality Creations Using Apple's ARKit

Popular Stories

iOS 18 Siri Integrated Feature

Report: These 10 New AI Features Are Coming in iOS 18

Sunday May 26, 2024 12:57 pm PDT by
iOS 18 and macOS 15 will offer an array of new AI features such as auto-generated emojis, suggested replies to emails and messages, and more, Bloomberg's Mark Gurman reports. A significant portion of Apple's Worldwide Developers Conference (WWDC) is expected to focus on AI features. Writing his latest "Power On" newsletter, Gurman explained that Apple's AI strategy emphasizes providing...
new best buy blue

Best Buy's Memorial Day Sale Has Record Low Prices on iPads, MacBooks, and Much More

Friday May 24, 2024 7:12 am PDT by
Best Buy today kicked off its Memorial Day weekend sale, and it has some of the best prices we've tracked in weeks on iPads and MacBooks. Specifically, you'll find record low prices on the 5th generation iPad Air, iPad mini 6, M2 MacBook Air, and M3 MacBook Pro. Note: MacRumors is an affiliate partner with Best Buy. When you click a link and make a purchase, we may receive a small payment,...
iOS 18 WWDC 24 Feature 2

Gurman: iOS 18 Will Allow Users to Recolor App Icons and Place Them Anywhere

Sunday May 26, 2024 12:22 pm PDT by
Apple's iOS 18 update will introduce new features for further customizing the iPhone's home screen, according to Bloomberg's Mark Gurman. In the latest edition of his "Power On" newsletter, Gurman claimed that Apple will allow users to change the color of app icons in iOS 18. For example, "you can make all your social icons blue or finance-related ones green." This kind of home screen...
Apple iPhone 14 color lineup feature

Apple Now Selling Refurbished iPhone 14 Models

Friday May 24, 2024 11:15 am PDT by
Apple today added refurbished iPhone 14, iPhone 14 Plus, iPhone 14 Pro, and iPhone 14 Pro Max devices to its online store for refurbished products, offering the prior-generation iPhones at a discount for the first time since their 2022 launch. The iPhone 14 is available starting at $619, the iPhone 14 Pro is available starting at $759, and the iPhone 14 Pro Max is available starting at $849. ...
top stories 25may2024

Top Stories: iOS 17.5.1 Fixes Concerning Photos Bug, All-New iPhone 17 Model Rumored, and More

Saturday May 25, 2024 6:00 am PDT by
It's been quite a week of Apple news and rumors, ranging from a concerning bug with deleted photos reappearing on users' devices to hot rumors about a new high-end iPhone model for 2025 and a MacBook with a foldable screen coming as soon as 2026. Other news and rumors this week included fresh expectations for iOS 18 features and new headphones from Sonos to compete head-to-head with AirPods...

Top Rated Comments

icrude Avatar
89 months ago
Really thought he was going to draw something else.
Score: 17 Votes (Like | Disagree)
jonnysods Avatar
89 months ago
This is so cool. Every time I see these demos I get excited about the possibilities.
Score: 8 Votes (Like | Disagree)
Zirel Avatar
89 months ago
“Sure Apple is behind in VR/AR, Microsoft and Google are so much advanced because they released a couple of juicy press releases and pretty demos in controlled environments.”
Score: 6 Votes (Like | Disagree)
FactVsOpinion Avatar
89 months ago
Call me a pessimist, but I just don't see any practical use in real life, nothing more than a gimmick, just like holograms when they showed them in Star Wars, 40 years later no practical use for everyday.

Don't get me wrong, nice to see companies investing in new technologies, but just because it's new and flashy, doesn't mean it's useful, and yes, like every new thing it will have a niche, but not an everyday use for regular people.
Couldn't disagree more.
[doublepost=1502306075][/doublepost]
These things make me want AR glasses again...

...Or a brain implant.
I think the lenses will certainly come. And then years later, an implant; perhaps from Musk's comapny
Score: 3 Votes (Like | Disagree)
melgross Avatar
89 months ago
It’s frustrating that Apple doesn’t have a beta section up in the App Store. In situations like this, where I run the iOS betas, I would love to have some of these AR betas on my iPad to play with, knowing, that since they are betas, that they might crash, or otherwise not function properly.
Score: 3 Votes (Like | Disagree)
naeS1Sean Avatar
89 months ago
These things make me want AR glasses again...

...Or a brain implant.
Score: 2 Votes (Like | Disagree)