"Hey Siri" support and possibly wireless charging case alongside AirPower charging mat.
AirPods and AirPower: Everything We Know
Latest ARKit Demo Showcases Virtual Drawing
Ahead of the launch of iOS 11, developers have been tinkering with ARKit, Apple's upcoming augmented reality platform, and showcasing the myriad ways that it can be used in apps and games.
The latest demo comes courtesy of Osama Abdel-Karim, who uses ARKit to virtually paint on a notepad using his fingers.
According to Abdel-Karim, an iOS 11 library named Vision was used to develop the virtual drawing feature. Vision includes an object tracking feature that is able to detect the thumbnail of a finger and track its movement to enable the drawing.
Abdel-Karim has outlined the steps he used to create his ARKit demo and provided the full source code for the project.
When it launches this fall, ARKit is positioned to become the largest AR Platform in the world, using the camera, processors, and motion sensors in the iPhone and iPad to create some incredibly impressive augmented reality interactions.
As outlined in our video covering ARKit, the feature uses technology called Visual Inertial Odometry to track the world around an iPad or iPhone, allowing a device to sense how it moves in a room. ARKit automatically analyzes a room's layout, detecting horizontal planes like tables and floors, which then allows virtual objects to be placed upon those surfaces.
Subscribe to the MacRumors YouTube channel for more videos.
The first apps and games with ARKit won't be available until iOS 11 is officially available to the public, but we've seen what ARKit can be used for, with developers demonstrating everything from live filter applications in a recreation of A-ha's Take On Me video to live measurements of furniture and room spaces.
Check out all of our previous ARKit coverage below to see what else developers can do with it:
- ARKit Roundup: Turn-by-Turn Directions, Precise Room Measurements, and Pac-Man
- Apple's ARKit Used to Recreate Classic A-ha 'Take On Me' Video
- Apple Users' Mixed Reality Future Teased in Latest ARKit Demo
- Latest Apps to Showcase Apple's ARKit Include Simple Measuring Tape and Minecraft
- Developers Share First Augmented Reality Creations Using Apple's ARKit
The latest demo comes courtesy of Osama Abdel-Karim, who uses ARKit to virtually paint on a notepad using his fingers.
According to Abdel-Karim, an iOS 11 library named Vision was used to develop the virtual drawing feature. Vision includes an object tracking feature that is able to detect the thumbnail of a finger and track its movement to enable the drawing.
Abdel-Karim has outlined the steps he used to create his ARKit demo and provided the full source code for the project.
When it launches this fall, ARKit is positioned to become the largest AR Platform in the world, using the camera, processors, and motion sensors in the iPhone and iPad to create some incredibly impressive augmented reality interactions.
As outlined in our video covering ARKit, the feature uses technology called Visual Inertial Odometry to track the world around an iPad or iPhone, allowing a device to sense how it moves in a room. ARKit automatically analyzes a room's layout, detecting horizontal planes like tables and floors, which then allows virtual objects to be placed upon those surfaces.
The first apps and games with ARKit won't be available until iOS 11 is officially available to the public, but we've seen what ARKit can be used for, with developers demonstrating everything from live filter applications in a recreation of A-ha's Take On Me video to live measurements of furniture and room spaces.
Check out all of our previous ARKit coverage below to see what else developers can do with it:
- ARKit Roundup: Turn-by-Turn Directions, Precise Room Measurements, and Pac-Man
- Apple's ARKit Used to Recreate Classic A-ha 'Take On Me' Video
- Apple Users' Mixed Reality Future Teased in Latest ARKit Demo
- Latest Apps to Showcase Apple's ARKit Include Simple Measuring Tape and Minecraft
- Developers Share First Augmented Reality Creations Using Apple's ARKit
Tags: ARKit, augmented reality
[ 61 comments ]
Top Rated Comments
(View all)
20 months ago
This is so cool. Every time I see these demos I get excited about the possibilities.
20 months ago
“Sure Apple is behind in VR/AR, Microsoft and Google are so much advanced because they released a couple of juicy press releases and pretty demos in controlled environments.”
20 months ago
It’s frustrating that Apple doesn’t have a beta section up in the App Store. In situations like this, where I run the iOS betas, I would love to have some of these AR betas on my iPad to play with, knowing, that since they are betas, that they might crash, or otherwise not function properly.
20 months ago
Call me a pessimist, but I just don't see any practical use in real life, nothing more than a gimmick, just like holograms when they showed them in Star Wars, 40 years later no practical use for everyday.
Don't get me wrong, nice to see companies investing in new technologies, but just because it's new and flashy, doesn't mean it's useful, and yes, like every new thing it will have a niche, but not an everyday use for regular people.
Couldn't disagree more.
[doublepost=1502306075][/doublepost]
These things make me want AR glasses again...
...Or a brain implant.
I think the lenses will certainly come. And then years later, an implant; perhaps from Musk's comapny
20 months ago
“Sure Apple is behind in VR/AR, Microsoft and Google are so much advanced.”
Apple are able to do this with a product that many people have on them all the time and has sold by the truck load e.g. iPhone/iPad
As much as the likes of HoloLens is awesome (working at Microsoft I have tried it numerous times) Apple have made this accessible to the everyday user which gives them the upper hand IMO.
20 months ago
“Sure Apple is behind in VR/AR, Microsoft and Google are so much advanced because they released a couple of juicy press releases and pretty demos in controlled environments.”
Then Google will drop the project in 2 years, release another gimmicks. Media talks about it as the next big thing, Google stocks goes up. The cycle never ends for Google and people don't realize that. While Microsoft wants to bring the technology to the market. Media ignores it while Microsoft keeps pushing. Eventually it takes them a while to realize they're losing money. Then go back on its money making business like Windows and MS Office and collecting royalties.
20 months ago
Oh sorry, my bad, that's why Google Glass was such a hit right o_O /s
Google Glasses were 1) Expensive, 2) Early. They didn't have wide scale accessibility that ARKit does, nor did they have the software to back them up. Eventually, we'll get to a point where wearable projection displays are in an affordable price range. But not right away. Until then we'll just have fumble one handed with a phone, or go for wearable (VR-like) head mounts for them.
And if that's your only response to the value of AR Guided Repairs, then you can be IBM and wonder what anyone would need with a Personal Computer in the first place. Or better yet, be one of those people who questioned what an oversized iPod (the iPad) will be used for.
Such AR guides and assistance are already in use in industry and will make the leap into the general user's hands.
Yawn... Welcome to 2013. And, the usability and input lag would be terrible.
So far with the ARKit projects being shown and discussed, no one has mentioned any kind of noticeable lag. Most seem to be praising the system for its responsiveness, even in unoptimized early tech demos.
20 months ago
Really thought he was going to draw something else.
Me too. Why are our minds wired to assume these things?
[ Read All Comments ]
The Gardena Smart System is now compatible with Apple's HomeKit, thanks to the availability of a software update that brings HomeKit integration to Gardena devices like the Smart Water Control,...
Apple this week was awarded a patent for a potential Apple Watch design featuring a flexible microLED display that integrates with and encompasses almost the entire watch band.
Titled...
In his wide-ranging research note today touching on Apple's product releases for 2019, Ming-Kuo provided a glimpse at upcoming AirPods, iPads, iPhones, displays and MacBook Pros. Regarding the...
For this week's giveaway, we've teamed up with Astropad to offer MacRumors readers a chance to win a Luna Display adapter. The Luna Display is a handy little dongle that's designed to...
In late November, Apple launched a limited time promotion that offers up to $100 in additional credit when trading in an iPhone 6 through iPhone 8 towards the purchase of a new iPhone XS or...
Apple today filed its 2018 Conflict Minerals Report with the SEC as part of its commitment to supplier responsibility.
Apple said it remains "deeply committed" to upholding human...
Apple's Beats by Dre brand today unveiled a new NBA collection, with Beats Studio 3 Wireless Headphones available in six colorways representing the Golden State Warriors, Los Angeles Lakers,...
Twitter CEO Jack Dorsey today commented on the possibility of an edit button for tweets, suggesting Twitter is considering a feature that might let people go back and add clarifications or...
