Developers Share First Augmented Reality Creations Using Apple's ARKit

Apple only announced its augmented reality developer platform ARKit last week at the Worldwide Developers Conference, but some video clips have already been posted online by developers eager to showcase the impressive potential of the software.

ARKit enables iPhones and iPads running iOS 11 to superimpose computer-generated graphics over the real world, allowing developers to take their apps beyond the screen and into the user's environment.

Apple ARKit running Unity and Overwatch Widowmaker, by Cody Brown

By using the built-in camera, processors, and motion sensors found in iOS devices, virtual content appears on top of real-world scenes, and users don't need any special equipment to enjoy them because ARKit does the heavy lifting.

One developer who spoke to Motherboard said Apple had improved upon existing AR solutions like Hololens and Google Tango by making the ARKit framework elegant and simple to use.

"The most impressive aspect of ARKit is that it tends to just work," said Cody Brown, founder of virtual reality production studio IRL, in an online interview with Motherboard. "Other AR software often requires some sort of physical tracking mechanism (like a QR code), which inevitably becomes a major piece of friction if you are trying to get anyone to use this stuff.

"Another incredible aspect of ARKit is how it handles lighting adjustments in real time, continued Brown. "I can only imagine the math and magic underneath this tech to make it work."

During its keynote at WWDC, Apple demoed a range of effects that ARKit is capable of. One demo by Wingnut Studios wowed the audience with a tabletop sci-fi raider assault. Another showed a user placing a steaming digital coffee mug and a lamp on a table and moving the objects around to show off the tracking and shadow effects.

Several other ARKit developer demos have since appeared online, including a virtual "iPhone 8", roving StarWars character BB-8, dog-stalking zombies, office floor naval battles, dancing Candy rock stars, and more.

Rainforest garage by 8ninths

Apple has invested heavily in augmented reality in recent years, making several VR/AR company acquisitions including PrimeSense, FaceShift, and Metaio. Apple's much-anticipated "iPhone 8", which is expected to be announced in September, is rumored to have 3D sensing capabilities, with augmented reality being one possible use for the technology.

ARKit will come to compatible devices as part of iOS 11, which Apple is set to release in the fall.

Related Roundup: Apple Vision Pro
Tag: ARKit
Buyer's Guide: Vision Pro (Buy Now)
Related Forums: Apple Vision Pro, iOS 11

Top Rated Comments

Telos101 Avatar
89 months ago
Ummm,..this video looks no different to every other AR app I own, am i missing something? This is what Apple has been working on,..a technology that has been used by IKEA for years...unimpressed.

I would have thought a pair of AR/ VR glasses would have been a priority for 2017.
I'm not sure you realize how difficult it was to build AR into iOS apps before ARKit entered the scene. The framework has only been out for a week and already indie devs are creating stuff that previously would have taken entire teams weeks or even months to produce. This is a game changer for sure, not only for games but for education apps too (anatomy, history, geography etc). The possibilities are endless.

Apple just shifted the goalposts.
Score: 35 Votes (Like | Disagree)
djcerla Avatar
89 months ago
After just a few days, and a developers-only release, iOS is already the dominant platform for AR. This is a market Apple will pioneer and dominate.

Who can miniaturize an AR device to the point it's actually desirable to wear? Only Apple. It's like all their work in chips and sensors of these last years is converging to make that single device possible.
Score: 15 Votes (Like | Disagree)
shly0718 Avatar
89 months ago
Im not super into these AR VR stuffs, but this is impressive, especially its on mobile hardware with minimum weight and no cords
Score: 13 Votes (Like | Disagree)
adnbek Avatar
89 months ago
Feels like 2013 again. Better late than never.

Fast forward to 6:54
I don't think you get it. AR has existed on iOS for years too, since 2010 at least. There are quite a few AR apps on the App Store already as well. What ARKit does is give developers access to new frameworks making developing these apps a lot easier and more powerful than the ones are currently possible.

But of course you knew that already and you're just trolling, so carry on.
Score: 12 Votes (Like | Disagree)
Kaibelf Avatar
89 months ago
Okay THAT is cool, and has a lot of potential.
Score: 12 Votes (Like | Disagree)
TallManNY Avatar
89 months ago
After just a few days, and a developers-only release, iOS is already the dominant platform for AR. This is a market Apple will pioneer and dominate.

Who can miniaturize an AR device to the point it's actually desirable to wear? Only Apple. It's like all their work in chips and sensors of these last years is converging to make that single device possible.
That is exactly what I've been thinking. The problem with the AR/VR glasses is that they are heavy and uncomfortable to wear. But Apple has the most powerful and most energy efficient chips. It also has great cameras. So they can make the best set of goggles. For now it will just be your phone (an $750 device, so pricey) sitting in a container similar to Samsung VR gear. But Apple can make something better and more powerful and still have it run on a battery that won't be that heavy. And all of Apple phones will have two cameras. Having two cameras will be key to AR. That is another happy coincidence.

Side note. Once again, Apple publicly announces dominance in a new field and the stock market doesn't get it.
Score: 11 Votes (Like | Disagree)

Popular Stories

reset password request iphone

Warning: Apple Users Targeted in Phishing Attack Involving Rapid Password Reset Requests

Tuesday March 26, 2024 4:34 pm PDT by
Phishing attacks taking advantage of Apple's password reset feature have become increasingly common, according to a report from KrebsOnSecurity. Multiple Apple users have been targeted in an attack that bombards them with an endless stream of notifications or multi-factor authentication (MFA) messages in an attempt to cause panic so they'll respond favorably to social engineering. An...
maxresdefault

Apple to Launch New iPad Pro and iPad Air Models in May

Thursday March 28, 2024 11:07 am PDT by
Apple will introduce new iPad Pro and iPad Air models in early May, according to Bloomberg's Mark Gurman. Gurman previously suggested the new iPads would come out in March, and then April, but the timeline has been pushed back once again. Subscribe to the MacRumors YouTube channel for more videos. Apple is working on updates to both the iPad Pro and iPad Air models. The iPad Pro models will...
Generic iOS 18 Feature Purple

iOS 18: What to Expect From 'Biggest' Update in iPhone's History

Wednesday March 27, 2024 11:10 am PDT by
At least some Apple software engineers continue to believe that iOS 18 will be the "biggest" update in the iPhone's history, according to Bloomberg's Mark Gurman. Below, we recap rumored features and changes for the iPhone. "The iOS 18 update is expected to be the most ambitious overhaul of the iPhone's software in its history, according to people working on the upgrade," wrote Gurman, in a r...
maxresdefault

Apple Announces WWDC 2024 Event for June 10 to 14

Tuesday March 26, 2024 10:02 am PDT by
Apple today announced that its 35th annual Worldwide Developers Conference is set to take place from Monday, June 10 to Friday, June 14. As with WWDC events since 2020, WWDC 2024 will be an online event that is open to all developers at no cost. Subscribe to the MacRumors YouTube channel for more videos. WWDC 2024 will include online sessions and labs so that developers can learn about new...
apple maps 3d feature

Apple Maps May Gain Custom Routes With iOS 18

Tuesday March 26, 2024 3:10 pm PDT by
Apple may be planning to add support for "custom routes" in Apple Maps in iOS 18, according to code reviewed by MacRumors. Apple Maps does not currently offer a way to input self-selected routes, with Maps users limited to Apple's pre-selected options, but that may change in iOS 18. Apple has pushed an iOS 18 file to its maps backend labeled "CustomRouteCreation." While not much is revealed...
General iOS 17 Feature Orange Purple

Apple Releases Revised Versions of iOS 17.4.1 and iPadOS 17.4.1 With Updated Build Number

Wednesday March 27, 2024 5:59 am PDT by
Apple on late Tuesday released revised versions of iOS 17.4.1 and iPadOS 17.4.1 with an updated build number of 21E237, according to MacRumors contributor Aaron Perris. The updates previously had a build number of 21E236. The revised updates are available for all iPhone and iPad models that are compatible with iOS 17 and iPadOS 17, but they can only be installed via the Finder app on macOS...
applephilschiller

Apple's Phil Schiller Works 80 Hours a Week Overseeing App Store

Wednesday March 27, 2024 2:03 pm PDT by
With the App Store and app ecosystem undergoing major changes in the European Union, The Wall Street Journal today shared a profile on App Store chief Phil Schiller, who is responsible for the App Store. Though Schiller transitioned from marketing chief to "Apple Fellow" in 2020 to take a step back from Apple and spend more time on personal projects and friends, he is reportedly working...