Developers Share First Augmented Reality Creations Using Apple's ARKit

by

Apple only announced its augmented reality developer platform ARKit last week at the Worldwide Developers Conference, but some video clips have already been posted online by developers eager to showcase the impressive potential of the software.

ARKit enables iPhones and iPads running iOS 11 to superimpose computer-generated graphics over the real world, allowing developers to take their apps beyond the screen and into the user's environment.

Apple ARKit running Unity and Overwatch Widowmaker, by Cody Brown

By using the built-in camera, processors, and motion sensors found in iOS devices, virtual content appears on top of real-world scenes, and users don't need any special equipment to enjoy them because ARKit does the heavy lifting.

One developer who spoke to Motherboard said Apple had improved upon existing AR solutions like Hololens and Google Tango by making the ARKit framework elegant and simple to use.

"The most impressive aspect of ARKit is that it tends to just work," said Cody Brown, founder of virtual reality production studio IRL, in an online interview with Motherboard. "Other AR software often requires some sort of physical tracking mechanism (like a QR code), which inevitably becomes a major piece of friction if you are trying to get anyone to use this stuff.

"Another incredible aspect of ARKit is how it handles lighting adjustments in real time, continued Brown. "I can only imagine the math and magic underneath this tech to make it work."

During its keynote at WWDC, Apple demoed a range of effects that ARKit is capable of. One demo by Wingnut Studios wowed the audience with a tabletop sci-fi raider assault. Another showed a user placing a steaming digital coffee mug and a lamp on a table and moving the objects around to show off the tracking and shadow effects.

Several other ARKit developer demos have since appeared online, including a virtual "iPhone 8", roving StarWars character BB-8, dog-stalking zombies, office floor naval battles, dancing Candy rock stars, and more.

Rainforest garage by 8ninths

Apple has invested heavily in augmented reality in recent years, making several VR/AR company acquisitions including PrimeSense, FaceShift, and Metaio. Apple's much-anticipated "iPhone 8", which is expected to be announced in September, is rumored to have 3D sensing capabilities, with augmented reality being one possible use for the technology.

ARKit will come to compatible devices as part of iOS 11, which Apple is set to release in the fall.

Related Roundup: Apple Vision Pro
Tag: ARKit
Buyer's Guide: Vision Pro (Buy Now)
Related Forums: Apple Vision Pro, iOS 11

Popular Stories

iOS 26

iOS 26.4 and iOS 27 Features Revealed in New Leak

Friday December 12, 2025 10:56 am PST by
Macworld's Filipe Espósito today revealed a handful of features that Apple is allegedly planning for iOS 26.4, iOS 27, and even iOS 28. The report said the features are referenced within the code for a leaked internal build of iOS 26 that is not meant to be seen by the public. However, it appears that Espósito and/or his sources managed to gain access to it, providing us with a sneak peek...
Read Full Article • 90 comments
Apple Logo Top Half

Early iOS 26 Software Leak Uncovers Dozens of Upcoming Apple Features

Monday December 15, 2025 3:05 pm PST by
Software from an iPhone prototype running an early build of iOS 26 leaked last week, giving us a glimpse at future Apple devices and iOS features. We recapped device codenames in our prior article, and now we have a list of some of the most notable feature flags that were found in the software code. In some cases, it's obvious what the feature flags are referring to, while some are more...
Read Full Article • 35 comments
apple beta 26 lineup

Apple Leak Confirms Work on Foldable iPhone, AirTag 2, and Dozens More Devices

Monday December 15, 2025 2:05 pm PST by
Last week, details about unreleased Apple devices and future iOS features were shared by Macworld. This week, we learned where the information came from, plus we have more findings from the leak. As it turns out, an Apple prototype device running an early build of iOS 26 was sold, and the person who bought it shared the software. The OS has a version number of 23A5234w, and the first...
Read Full Article • 79 comments
Apple Foldable Thumb

Leak Reveals Foldable iPhone Details

Monday December 15, 2025 9:09 am PST by
The first foldable iPhone will feature a series of design and hardware firsts for Apple, according to details shared by the Weibo leaker known as Digital Chat Station. According to a new post, via machine translation, Apple is developing what the leaker describes as a "wide foldable" device, a term used to refer to a horizontally oriented, book-style foldable with a large internal display....
Read Full Article • 157 comments
iOS 26

iOS 26.3 Beta 1 Features: What's New So Far

Monday December 15, 2025 4:23 pm PST by
Apple is testing iOS 26.3, the next version of iOS 26 that will launch around January. Since iOS 26.3's testing is happening over the holidays, it is a smaller update with fewer features than we've seen in prior betas. We've rounded up what's new so far, and we'll add to our list with subsequent betas if we come across any other features. Transfer to Android Apple is making it simpler...
Read Full Article • 42 comments
iOS 26

Apple Releases iOS 26.2 With Alarms for Reminders, Lock Screen Changes, Enhanced Safety Alerts and More

Friday December 12, 2025 10:10 am PST by
Apple today released iOS 26.2, the second major update to the iOS 26 operating system that came out in September, iOS 26.2 comes a little over a month after iOS 26.1 launched. ‌iOS 26‌.2 is compatible with the ‌iPhone‌ 11 series and later, as well as the second-generation ‌iPhone‌ SE. The new software can be downloaded on eligible iPhones over-the-air by going to Settings >...
Read Full Article • 111 comments
airpods max 2024 colors

AirPods Max 2 Likely to Offer These 10 New Features

Monday December 15, 2025 7:41 am PST by
Apple released the AirPods Max on December 15, 2020, meaning the over-ear headphones launched five years ago today. While the AirPods Max were updated with a USB-C port and new color options last year, followed by support for lossless audio and ultra-low latency audio this year, the headphones lack some of the features that have been introduced for newer generations of the regular AirPods and the ...
Read Full Article • 36 comments
iOS 26

iOS 26.2 Coming Soon With These 8 New Features on Your iPhone

Thursday December 11, 2025 8:49 am PST by
Apple seeded the second iOS 26.2 Release Candidate to developers earlier this week, meaning the update will be released to the general public very soon. Apple confirmed iOS 26.2 would be released in December, but it did not provide a specific date. We expect the update to be released by early next week. iOS 26.2 includes a handful of new features and changes on the iPhone, such as a new...
Read Full Article • 82 comments

Top Rated Comments

Telos101 Avatar
Telos101
111 months ago
Ummm,..this video looks no different to every other AR app I own, am i missing something? This is what Apple has been working on,..a technology that has been used by IKEA for years...unimpressed.

I would have thought a pair of AR/ VR glasses would have been a priority for 2017.
I'm not sure you realize how difficult it was to build AR into iOS apps before ARKit entered the scene. The framework has only been out for a week and already indie devs are creating stuff that previously would have taken entire teams weeks or even months to produce. This is a game changer for sure, not only for games but for education apps too (anatomy, history, geography etc). The possibilities are endless.

Apple just shifted the goalposts.
Score: 35 Votes (Like | Disagree)
djcerla Avatar
djcerla
111 months ago
After just a few days, and a developers-only release, iOS is already the dominant platform for AR. This is a market Apple will pioneer and dominate.

Who can miniaturize an AR device to the point it's actually desirable to wear? Only Apple. It's like all their work in chips and sensors of these last years is converging to make that single device possible.
Score: 15 Votes (Like | Disagree)
shly0718 Avatar
shly0718
111 months ago
Im not super into these AR VR stuffs, but this is impressive, especially its on mobile hardware with minimum weight and no cords
Score: 13 Votes (Like | Disagree)
adnbek Avatar
adnbek
111 months ago
Feels like 2013 again. Better late than never.

Fast forward to 6:54
I don't think you get it. AR has existed on iOS for years too, since 2010 at least. There are quite a few AR apps on the App Store already as well. What ARKit does is give developers access to new frameworks making developing these apps a lot easier and more powerful than the ones are currently possible.

But of course you knew that already and you're just trolling, so carry on.
Score: 12 Votes (Like | Disagree)
Kaibelf Avatar
Kaibelf
111 months ago
Okay THAT is cool, and has a lot of potential.
Score: 12 Votes (Like | Disagree)
TallManNY Avatar
TallManNY
111 months ago
After just a few days, and a developers-only release, iOS is already the dominant platform for AR. This is a market Apple will pioneer and dominate.

Who can miniaturize an AR device to the point it's actually desirable to wear? Only Apple. It's like all their work in chips and sensors of these last years is converging to make that single device possible.
That is exactly what I've been thinking. The problem with the AR/VR glasses is that they are heavy and uncomfortable to wear. But Apple has the most powerful and most energy efficient chips. It also has great cameras. So they can make the best set of goggles. For now it will just be your phone (an $750 device, so pricey) sitting in a container similar to Samsung VR gear. But Apple can make something better and more powerful and still have it run on a battery that won't be that heavy. And all of Apple phones will have two cameras. Having two cameras will be key to AR. That is another happy coincidence.

Side note. Once again, Apple publicly announces dominance in a new field and the stock market doesn't get it.
Score: 11 Votes (Like | Disagree)
Read All Comments