Latest ARKit Demo Showcases Virtual Drawing
Ahead of the launch of iOS 11, developers have been tinkering with ARKit, Apple's upcoming augmented reality platform, and showcasing the myriad ways that it can be used in apps and games.
The latest demo comes courtesy of Osama Abdel-Karim, who uses ARKit to virtually paint on a notepad using his fingers.
According to Abdel-Karim, an iOS 11 library named Vision was used to develop the virtual drawing feature. Vision includes an object tracking feature that is able to detect the thumbnail of a finger and track its movement to enable the drawing.
Abdel-Karim has outlined the steps he used to create his ARKit demo and provided the full source code for the project.
When it launches this fall, ARKit is positioned to become the largest AR Platform in the world, using the camera, processors, and motion sensors in the iPhone and iPad to create some incredibly impressive augmented reality interactions.
As outlined in our video covering ARKit, the feature uses technology called Visual Inertial Odometry to track the world around an iPad or iPhone, allowing a device to sense how it moves in a room. ARKit automatically analyzes a room's layout, detecting horizontal planes like tables and floors, which then allows virtual objects to be placed upon those surfaces.
The first apps and games with ARKit won't be available until iOS 11 is officially available to the public, but we've seen what ARKit can be used for, with developers demonstrating everything from live filter applications in a recreation of A-ha's Take On Me video to live measurements of furniture and room spaces.
Check out all of our previous ARKit coverage below to see what else developers can do with it:
- ARKit Roundup: Turn-by-Turn Directions, Precise Room Measurements, and Pac-Man
- Apple's ARKit Used to Recreate Classic A-ha 'Take On Me' Video
- Apple Users' Mixed Reality Future Teased in Latest ARKit Demo
- Latest Apps to Showcase Apple's ARKit Include Simple Measuring Tape and Minecraft
- Developers Share First Augmented Reality Creations Using Apple's ARKit
Popular Stories
We've been focusing on deals on physical products over the past few weeks, but Black Friday is also a great time of year to purchase a streaming membership. Some of the biggest services have great discounts for new and select returning members this week, including Disney+, Hulu, Paramount+, Peacock, and more.
Note: MacRumors is an affiliate partner with some of these vendors. When you click a...
Apple's first foldable iPhone is expected to launch alongside the iPhone 18 Pro models in fall 2026, and it's shaping up to include three standout features that could set it apart from the competition.
The book-style foldable will reportedly feature an industry-first 24-megapixel under-display camera built into the inner display, according to a recent JP Morgan equity research report. That...
We're only a few days away from Black Friday, which will take place on Friday, November 28 in 2025. As always, this will be the best time of the year to shop for great deals, including popular Apple products like AirPods, iPad, Apple Watch, and more. In this article, the majority of the discounts will be found on Amazon.
Note: MacRumors is an affiliate partner with some of these vendors. When...
Singapore has ordered Apple to block or filter messages on iMessage that impersonate government agencies, requiring the company to implement new anti-spoofing protections by December as part of efforts to curb rising online scams, the Straits Times reports.
Singapore's Ministry of Home Affairs (MHA) said that it had issued an Implementation Directive to Apple under the Online Criminal Harms...
Apple recently teamed up with Japanese fashion brand ISSEY MIYAKE to create the iPhone Pocket, a limited-edition knitted accessory designed to carry an iPhone. However, it is now completely sold out in all countries where it was released.
iPhone Pocket became available to order on Apple's online store starting Friday, November 14, in the United States, France, China, Italy, Japan, Singapore, ...
On this week's episode of The MacRumors Show, we talk through all of the new features and improvements expected to come to next year's iPhone 18 Pro and iPhone 18 Pro Max models.
Subscribe to The MacRumors Show YouTube channel for more videos
Apple's next-generation iPhones are less than ten months away and we already have a good idea about what to expect based on corroborated leaks, rumors,...
iOS 26.2 is currently in beta testing. The upcoming update includes a handful of new features and changes on the iPhone, including a new Liquid Glass slider for the Lock Screen's clock, offline lyrics for Apple Music, and more.
In a recent press release, Apple confirmed that iOS 26.2 will be released to all users in December, but it did not provide a specific release date.
Keep reading...
iOS 27 will reportedly have two major elements: quality improvements and new AI features.
In his Power On newsletter today, Bloomberg's Mark Gurman said that iOS 27 will be similar to Mac OS X Snow Leopard, in the sense that Apple is focused on improving "quality and underlying performance" over adding new features.
Gurman said there is one exception to this rule, though, as he expects...
American multinational news company CNN has abruptly pulled its content from Apple News, Semafor reports.
CNN quietly removed its stories from Apple News over the weekend and there is no longer a feed from the network to subscribe to in the app. This effectively ends its distribution agreement with Apple while the two sides negotiate new terms. Discussions are apparently ongoing and CNN's...
