Developers Share First Augmented Reality Creations Using Apple's ARKit

Apple only announced its augmented reality developer platform ARKit last week at the Worldwide Developers Conference, but some video clips have already been posted online by developers eager to showcase the impressive potential of the software.

ARKit enables iPhones and iPads running iOS 11 to superimpose computer-generated graphics over the real world, allowing developers to take their apps beyond the screen and into the user's environment.

Apple ARKit running Unity and Overwatch Widowmaker, by Cody Brown

By using the built-in camera, processors, and motion sensors found in iOS devices, virtual content appears on top of real-world scenes, and users don't need any special equipment to enjoy them because ARKit does the heavy lifting.

One developer who spoke to Motherboard said Apple had improved upon existing AR solutions like Hololens and Google Tango by making the ARKit framework elegant and simple to use.

"The most impressive aspect of ARKit is that it tends to just work," said Cody Brown, founder of virtual reality production studio IRL, in an online interview with Motherboard. "Other AR software often requires some sort of physical tracking mechanism (like a QR code), which inevitably becomes a major piece of friction if you are trying to get anyone to use this stuff.

"Another incredible aspect of ARKit is how it handles lighting adjustments in real time, continued Brown. "I can only imagine the math and magic underneath this tech to make it work."

During its keynote at WWDC, Apple demoed a range of effects that ARKit is capable of. One demo by Wingnut Studios wowed the audience with a tabletop sci-fi raider assault. Another showed a user placing a steaming digital coffee mug and a lamp on a table and moving the objects around to show off the tracking and shadow effects.

Several other ARKit developer demos have since appeared online, including a virtual "iPhone 8", roving StarWars character BB-8, dog-stalking zombies, office floor naval battles, dancing Candy rock stars, and more.

Rainforest garage by 8ninths

Apple has invested heavily in augmented reality in recent years, making several VR/AR company acquisitions including PrimeSense, FaceShift, and Metaio. Apple's much-anticipated "iPhone 8", which is expected to be announced in September, is rumored to have 3D sensing capabilities, with augmented reality being one possible use for the technology.

ARKit will come to compatible devices as part of iOS 11, which Apple is set to release in the fall.

Related Roundup: Apple Vision Pro
Tag: ARKit
Buyer's Guide: Vision Pro (Buy Now)
Related Forums: Apple Vision Pro, iOS 11

Popular Stories

New Things Your iPhone Can Do in iOS 18

18 New Things Your iPhone Can Do in iOS 18.2

Wednesday November 27, 2024 5:05 am PST by
Apple is set to release iOS 18.2 in early December, bringing the second round of Apple Intelligence features to iPhone 15 Pro and iPhone 16 models. This update brings several major advancements to Apple's AI integration, including completely new image generation tools and a range of Visual Intelligence-based enhancements. There are a handful of new non-AI related feature controls incoming as...
iphone 16 pro models 1

12 Reasons to Wait for Next Year's iPhone 17

Friday November 29, 2024 5:17 am PST by
Apple's iPhone development roadmap runs several years into the future and the company is continually working with suppliers on several successive iPhone models simultaneously, which is why we sometimes get rumored feature leaks so far ahead of launch. The iPhone 17 series is no different – already we have some idea of what to expect from Apple's 2025 smartphone lineup. If you plan to skip...
Whatsapp Feature

WhatsApp to Drop Support for These iPhones Starting May 2025

Monday December 2, 2024 2:57 am PST by
WhatsApp is set to end support for iOS versions older than iOS 15.1 from May next year, removing the chat platform's compatibility with several iPhone models in the process. From May 5, 2025, WhatsApp will no longer be compatible with iPhone 5s, iPhone 6, and iPhone 6 Plus models. Users with those devices won't be able to access the encrypted chat service after the specified date unless they ...
Apple AI Command Center Concept Mock 3

Apple Expected to Launch This All-New Device Next Year

Wednesday November 27, 2024 1:05 pm PST by
Apple is expected to kick off 2025 by launching an all-new smart home hub, also referred to as a "command center," as early as March. The hub is expected to feature around a six-inch display that can be attached to a tabletop base with a speaker, or mounted on a wall. The device is said to run a new "homeOS" operating system with a customizable widget-focused home screen, and it is expected...
iPhone 17 Pro Dual Tone Rectangle Feature 1

iPhone 17 Pro Already Rumored to Have These 8 New Features

Wednesday November 27, 2024 12:19 pm PST by
While the iPhone 17 Pro and iPhone 17 Pro Max are not expected to launch for 10 more months, there are already plenty of rumors about the devices. An imaginative iPhone 17 Pro concept based on rumors Below, we recap key changes rumored for the iPhone 17 Pro models so far: Aluminum frame: iPhone 17 Pro models are rumored to have an aluminum frame, whereas the iPhone 15 Pro and iPhone 16 Pro ...
maxresdefault

The MacRumors Show: iPhone 17 Designs Revealed!

Friday November 29, 2024 9:34 am PST by
On this week's episode of The MacRumors Show, we discuss the recently leaked design of the iPhone 17 "Air" and iPhone 17 Pro. Subscribe to The MacRumors Show YouTube channel for more videos Earlier this week, a report from The Information's Wayne Ma revealed that the iPhone 17 Air will have a thickness of between 5mm and 6mm, which would make it the thinnest iPhone ever. In comparison, iPhone ...
airpods pro 2 gradient

AirPods Pro 3 Expected Next Year: Here's What We Know

Thursday November 28, 2024 3:30 am PST by
Despite being released over two years ago, Apple's AirPods Pro 2 continue to dominate the wireless earbud market. However, with the AirPods Pro 3 expected to launch sometime in 2025, anyone thinking of buying Apple's premium earbuds may be wondering if the next generation is worth holding out for. Apart from their audio and noise-canceling performance, which are generally regarded as...
Cyber Monday Deals Feature 2022

Apple Cyber Week Deals Available Now: AirPods, iPads, and More

Sunday December 1, 2024 7:52 am PST by
Although Black Friday has ended, Cyber Week is here and you can find great deals on numerous Apple devices right now. This includes big savings on AirPods, Apple Watch, MacBook Air, iPad, and more. Note: MacRumors is an affiliate partner with some of these vendors. When you click a link and make a purchase, we may receive a small payment, which helps us keep the site running. Specifically,...

Top Rated Comments

Telos101 Avatar
98 months ago
Ummm,..this video looks no different to every other AR app I own, am i missing something? This is what Apple has been working on,..a technology that has been used by IKEA for years...unimpressed.

I would have thought a pair of AR/ VR glasses would have been a priority for 2017.
I'm not sure you realize how difficult it was to build AR into iOS apps before ARKit entered the scene. The framework has only been out for a week and already indie devs are creating stuff that previously would have taken entire teams weeks or even months to produce. This is a game changer for sure, not only for games but for education apps too (anatomy, history, geography etc). The possibilities are endless.

Apple just shifted the goalposts.
Score: 35 Votes (Like | Disagree)
djcerla Avatar
98 months ago
After just a few days, and a developers-only release, iOS is already the dominant platform for AR. This is a market Apple will pioneer and dominate.

Who can miniaturize an AR device to the point it's actually desirable to wear? Only Apple. It's like all their work in chips and sensors of these last years is converging to make that single device possible.
Score: 15 Votes (Like | Disagree)
shly0718 Avatar
98 months ago
Im not super into these AR VR stuffs, but this is impressive, especially its on mobile hardware with minimum weight and no cords
Score: 13 Votes (Like | Disagree)
adnbek Avatar
98 months ago
Feels like 2013 again. Better late than never.

Fast forward to 6:54
I don't think you get it. AR has existed on iOS for years too, since 2010 at least. There are quite a few AR apps on the App Store already as well. What ARKit does is give developers access to new frameworks making developing these apps a lot easier and more powerful than the ones are currently possible.

But of course you knew that already and you're just trolling, so carry on.
Score: 12 Votes (Like | Disagree)
Kaibelf Avatar
98 months ago
Okay THAT is cool, and has a lot of potential.
Score: 12 Votes (Like | Disagree)
TallManNY Avatar
98 months ago
After just a few days, and a developers-only release, iOS is already the dominant platform for AR. This is a market Apple will pioneer and dominate.

Who can miniaturize an AR device to the point it's actually desirable to wear? Only Apple. It's like all their work in chips and sensors of these last years is converging to make that single device possible.
That is exactly what I've been thinking. The problem with the AR/VR glasses is that they are heavy and uncomfortable to wear. But Apple has the most powerful and most energy efficient chips. It also has great cameras. So they can make the best set of goggles. For now it will just be your phone (an $750 device, so pricey) sitting in a container similar to Samsung VR gear. But Apple can make something better and more powerful and still have it run on a battery that won't be that heavy. And all of Apple phones will have two cameras. Having two cameras will be key to AR. That is another happy coincidence.

Side note. Once again, Apple publicly announces dominance in a new field and the stock market doesn't get it.
Score: 11 Votes (Like | Disagree)