New in OS X: Get MacRumors Push Notifications on your Mac

Resubscribe Now Close

Latest ARKit Demo Showcases Virtual Drawing

Ahead of the launch of iOS 11, developers have been tinkering with ARKit, Apple's upcoming augmented reality platform, and showcasing the myriad ways that it can be used in apps and games.

The latest demo comes courtesy of Osama Abdel-Karim, who uses ARKit to virtually paint on a notepad using his fingers.


According to Abdel-Karim, an iOS 11 library named Vision was used to develop the virtual drawing feature. Vision includes an object tracking feature that is able to detect the thumbnail of a finger and track its movement to enable the drawing.

Abdel-Karim has outlined the steps he used to create his ARKit demo and provided the full source code for the project.

When it launches this fall, ARKit is positioned to become the largest AR Platform in the world, using the camera, processors, and motion sensors in the iPhone and iPad to create some incredibly impressive augmented reality interactions.

As outlined in our video covering ARKit, the feature uses technology called Visual Inertial Odometry to track the world around an iPad or iPhone, allowing a device to sense how it moves in a room. ARKit automatically analyzes a room's layout, detecting horizontal planes like tables and floors, which then allows virtual objects to be placed upon those surfaces.

Subscribe to the MacRumors YouTube channel for more videos.

The first apps and games with ARKit won't be available until iOS 11 is officially available to the public, but we've seen what ARKit can be used for, with developers demonstrating everything from live filter applications in a recreation of A-ha's Take On Me video to live measurements of furniture and room spaces.

Check out all of our previous ARKit coverage below to see what else developers can do with it:

- ARKit Roundup: Turn-by-Turn Directions, Precise Room Measurements, and Pac-Man
- Apple's ARKit Used to Recreate Classic A-ha 'Take On Me' Video
- Apple Users' Mixed Reality Future Teased in Latest ARKit Demo
- Latest Apps to Showcase Apple's ARKit Include Simple Measuring Tape and Minecraft
- Developers Share First Augmented Reality Creations Using Apple's ARKit



Top Rated Comments

(View all)

20 months ago
Really thought he was going to draw something else.
Rating: 17 Votes
20 months ago
This is so cool. Every time I see these demos I get excited about the possibilities.
Rating: 8 Votes
20 months ago
“Sure Apple is behind in VR/AR, Microsoft and Google are so much advanced because they released a couple of juicy press releases and pretty demos in controlled environments.”
Rating: 6 Votes
20 months ago
It’s frustrating that Apple doesn’t have a beta section up in the App Store. In situations like this, where I run the iOS betas, I would love to have some of these AR betas on my iPad to play with, knowing, that since they are betas, that they might crash, or otherwise not function properly.
Rating: 3 Votes
20 months ago

Call me a pessimist, but I just don't see any practical use in real life, nothing more than a gimmick, just like holograms when they showed them in Star Wars, 40 years later no practical use for everyday.

Don't get me wrong, nice to see companies investing in new technologies, but just because it's new and flashy, doesn't mean it's useful, and yes, like every new thing it will have a niche, but not an everyday use for regular people.


Couldn't disagree more.
[doublepost=1502306075][/doublepost]

These things make me want AR glasses again...

...Or a brain implant.


I think the lenses will certainly come. And then years later, an implant; perhaps from Musk's comapny
Rating: 3 Votes
20 months ago

“Sure Apple is behind in VR/AR, Microsoft and Google are so much advanced.”


Apple are able to do this with a product that many people have on them all the time and has sold by the truck load e.g. iPhone/iPad

As much as the likes of HoloLens is awesome (working at Microsoft I have tried it numerous times) Apple have made this accessible to the everyday user which gives them the upper hand IMO.
Rating: 2 Votes
20 months ago
These things make me want AR glasses again...

...Or a brain implant.
Rating: 2 Votes
20 months ago

“Sure Apple is behind in VR/AR, Microsoft and Google are so much advanced because they released a couple of juicy press releases and pretty demos in controlled environments.”

Then Google will drop the project in 2 years, release another gimmicks. Media talks about it as the next big thing, Google stocks goes up. The cycle never ends for Google and people don't realize that. While Microsoft wants to bring the technology to the market. Media ignores it while Microsoft keeps pushing. Eventually it takes them a while to realize they're losing money. Then go back on its money making business like Windows and MS Office and collecting royalties.
Rating: 1 Votes
20 months ago

Oh sorry, my bad, that's why Google Glass was such a hit right o_O /s


Google Glasses were 1) Expensive, 2) Early. They didn't have wide scale accessibility that ARKit does, nor did they have the software to back them up. Eventually, we'll get to a point where wearable projection displays are in an affordable price range. But not right away. Until then we'll just have fumble one handed with a phone, or go for wearable (VR-like) head mounts for them.

And if that's your only response to the value of AR Guided Repairs, then you can be IBM and wonder what anyone would need with a Personal Computer in the first place. Or better yet, be one of those people who questioned what an oversized iPod (the iPad) will be used for.

Such AR guides and assistance are already in use in industry and will make the leap into the general user's hands.

Yawn... Welcome to 2013. And, the usability and input lag would be terrible.


So far with the ARKit projects being shown and discussed, no one has mentioned any kind of noticeable lag. Most seem to be praising the system for its responsiveness, even in unoptimized early tech demos.
Rating: 1 Votes
20 months ago

Really thought he was going to draw something else.


Me too. Why are our minds wired to assume these things?
Rating: 1 Votes

[ Read All Comments ]