Hands-On With Apple's 'ARKit' Augmented Reality Demo for Developers

With iOS 11, Apple is delving into augmented reality in a big way, introducing an ARKit development platform that will allow developers to quickly and easily build augmented reality experiences into their apps and games.

ARKit is positioned to be the largest AR platform in the world when it launches this fall, using the camera, processors, and motion sensors in the iPhone and iPad to create some incredibly impressive augmented reality interactions.

While we won't see the first augmented reality apps and games built on ARKit for a couple of months, Apple has an ARKit demo app to show off what ARKit can do. We went hands-on with the demo to give MacRumors readers just a small taste of what to expect.


ARKit uses technology called Visual Inertial Odometry to track the world around an iPad or iPhone, allowing a device to sense how it moves in a room. ARKit automatically analyzes a room's layout, detecting horizontal planes like tables and floors, which then allows virtual objects to be placed upon those surfaces.

With ARKit able to place any virtual object within a physical room, developers can create all kinds of unique experiences, and developers have already released several demos showing what might be possible.

Apple already has at least one major retailer on board to use ARKit -- IKEA. IKEA is developing a new augmented reality app built on ARKit that will let customers preview IKEA products in their own homes before making a purchase. IKEA has offered augmented reality functionality for a few years now, but the company says Apple's new platform will much improve the experience. With ARKit available, IKEA says augmented reality will now "play a key role" in new product lines.

For additional details on other developer tools and features coming in iOS 11, make sure to check out our full iOS 11 roundup.

Related Roundup: Apple Vision Pro
Tag: ARKit
Buyer's Guide: Vision Pro (Buy Now)
Related Forums: Apple Vision Pro, iOS 11

Popular Stories

election results 2024 live activities

Track 2024 U.S. Election Results Live on Your iPhone Lock Screen

Tuesday November 5, 2024 5:02 am PST by
Apple News is providing Live Activities support for the 2024 U.S. presidential election, allowing iPhone and iPad users to track electoral results in real time directly from their Lock Screen. The feature is rolling out for U.S. users over the course of Election Day, November 5, providing continuous updates of the electoral count. So if you're interested, you don't need to repeatedly check...
ios 18 2 chatgpt plus

iOS 18.2 Beta 2 Shows Siri ChatGPT Limit, Offers 'Plus' Upgrade Option

Monday November 4, 2024 10:54 am PST by
With the second beta of iOS 18.2 that's available for developers today, Apple has further fleshed out the ChatGPT integration that's available with Siri. In the Settings app, there's now a section that shows the ChatGPT daily limit, and offers an option to upgrade to the paid ChatGPT Plus plan. The beta includes an Advanced Capabilities section with a "Daily Limit" reading that shows up as...
New Things Your iPhone Can Do in iOS 18

10 New Things Your iPhone Can Do in iOS 18.2

Thursday October 31, 2024 9:42 am PDT by
Apple is set to release iOS 18.2 in December, bringing the second round of Apple Intelligence features to iPhone 15 Pro and iPhone 16 models. This update brings several major advancements to Apple's AI integration, including completely new image generation tools and a range of Visual Intelligence-based enhancements. There are a handful of new non-AI related feature controls incoming as well. ...
Generic iOS 18

Everything New in iOS 18.2 Beta 2

Monday November 4, 2024 12:34 pm PST by
Apple today seeded the second betas of upcoming iOS 18.2 and iPadOS 18.2 updates to developers, and Apple is continuing to refine the Apple Intelligence capabilities. There are also a handful of smaller features that are worth knowing about. Find My Find My has a new option to Share Item Location with an "airline or trusted person" that can help you locate something that you've misplaced....
best early black friday deals

The Best Early Black Friday Apple Deals

Friday November 1, 2024 8:21 am PDT by
We're officially in the month of Black Friday, which will take place on Friday, November 29 in 2024. As always, this will be the best time of the year to shop for great deals, including popular Apple products like AirPods, iPad, Apple Watch, and more. Note: MacRumors is an affiliate partner with some of these vendors. When you click a link and make a purchase, we may receive a small payment,...
M4 M4 Pro vs M4 Max Feature

When to Expect New M4 MacBook Air, Mac Studio, and Mac Pro Models

Monday November 4, 2024 2:36 am PST by
Apple's fall 2024 Mac announcements have included new iMac, Mac mini, and MacBook Pro models, all of which debuted with variants of Apple's M4 chip. Apple intends to update the rest of its Mac lineup with M4 series processors over the next 12 months, which will make it the first time that Apple has used the same chip generation across all of its Macs. This means we can expect new M4...
M4 Pro on Blue

M4 Pro Chip Benchmark Results Reveal an Extremely Impressive Performance Feat

Thursday October 31, 2024 7:06 pm PDT by
The first Geekbench 6 benchmark results for the M4 Pro chip surfaced today. Impressively, the results that are available so far show that the highest-end M4 Pro chip is faster than the highest-end M2 Ultra chip in terms of peak multi-core CPU performance. Here is a comparison of the results: Mac mini with M4 Pro (14-core CPU): 22,094 multi-core score (average of 11 results) Mac Studio...

Top Rated Comments

FactVsOpinion Avatar
96 months ago
It's one of these technologies where you just know there will amazing use cases and applications all over the place, but it's pretty hard to imagine many specific examples.
Score: 7 Votes (Like | Disagree)
Nevaborn Avatar
96 months ago
AR was always the dream. I knew Apple would nail it. From game interaction to customising home design and using the camera to view and find out information about the world around you.AR really is the next step in technology. VR has its place for games and entertainment but AR is a tool for every day life.
Score: 5 Votes (Like | Disagree)
Jeremy1026 Avatar
96 months ago
The technology is cool, but nothing practical that convinces me to spend $800 on a head set.
You're confusing VR (Virtual Reality, headsets) with AR (Augmented Reality, adding to the image on your screen).
Score: 4 Votes (Like | Disagree)
djcerla Avatar
96 months ago
This is the next gold rush.
Score: 4 Votes (Like | Disagree)
mi7chy Avatar
96 months ago
DRAM is going to limit the number and complexity of objects loaded along with a newer GPU required for decent performance. I can see needing the 2017 iPad Pros with 4GB DRAM and GPUs to have a positive experience.
Score: 3 Votes (Like | Disagree)
teh29 Avatar
96 months ago
Does anyone know how to get this demo? Is it on the developer portal? I can't seem to find it.
The code is available under "Resources" of this WWDC ARKit video...

https://developer.apple.com/videos/play/wwdc2017/602/
Score: 3 Votes (Like | Disagree)