Hands-On With Apple's 'ARKit' Augmented Reality Demo for Developers

With iOS 11, Apple is delving into augmented reality in a big way, introducing an ARKit development platform that will allow developers to quickly and easily build augmented reality experiences into their apps and games.

ARKit is positioned to be the largest AR platform in the world when it launches this fall, using the camera, processors, and motion sensors in the iPhone and iPad to create some incredibly impressive augmented reality interactions.

While we won't see the first augmented reality apps and games built on ARKit for a couple of months, Apple has an ARKit demo app to show off what ARKit can do. We went hands-on with the demo to give MacRumors readers just a small taste of what to expect.


ARKit uses technology called Visual Inertial Odometry to track the world around an iPad or iPhone, allowing a device to sense how it moves in a room. ARKit automatically analyzes a room's layout, detecting horizontal planes like tables and floors, which then allows virtual objects to be placed upon those surfaces.

With ARKit able to place any virtual object within a physical room, developers can create all kinds of unique experiences, and developers have already released several demos showing what might be possible.

Apple already has at least one major retailer on board to use ARKit -- IKEA. IKEA is developing a new augmented reality app built on ARKit that will let customers preview IKEA products in their own homes before making a purchase. IKEA has offered augmented reality functionality for a few years now, but the company says Apple's new platform will much improve the experience. With ARKit available, IKEA says augmented reality will now "play a key role" in new product lines.

For additional details on other developer tools and features coming in iOS 11, make sure to check out our full iOS 11 roundup.

Related Roundup: Apple Vision Pro
Tag: ARKit
Buyer's Guide: Vision Pro (Neutral)
Related Forums: Apple Vision Pro, iOS 11

Popular Stories

iphone 16 display

iPhone 17's Scratch Resistant Anti-Reflective Display Coating Canceled

Monday April 28, 2025 12:48 pm PDT by
Apple may have canceled the super scratch resistant anti-reflective display coating that it planned to use for the iPhone 17 Pro models, according to a source with reliable information that spoke to MacRumors. Last spring, Weibo leaker Instant Digital suggested Apple was working on a new anti-reflective display layer that was more scratch resistant than the Ceramic Shield. We haven't heard...
iPhone 17 Air Pastel Feature

iPhone 17 Reaches Key Milestone Ahead of Mass Production

Monday April 28, 2025 8:44 am PDT by
Apple has completed Engineering Validation Testing (EVT) for at least one iPhone 17 model, according to a paywalled preview of an upcoming DigiTimes report. iPhone 17 Air mockup based on rumored design The EVT stage involves Apple testing iPhone 17 prototypes to ensure the hardware works as expected. There are still DVT (Design Validation Test) and PVT (Production Validation Test) stages to...
iphone 17 air iphone 16 pro

iPhone 17 Air USB-C Port May Have This Unusual Design Quirk

Wednesday April 30, 2025 3:59 am PDT by
Apple is preparing to launch a dramatically thinner iPhone this September, and if recent leaks are anything to go by, the so-called iPhone 17 Air could boast one of the most radical design shifts in recent years. iPhone 17 Air dummy model alongside iPhone 16 Pro (credit: AppleTrack) At just 5.5mm thick (excluding a slightly raised camera bump), the 6.6-inch iPhone 17 Air is expected to become ...
Beyond iPhone 13 Better Blue

20th Anniversary iPhone Likely to Be Made in China Due to 'Extraordinarily Complex' Design

Monday April 28, 2025 4:29 am PDT by
Apple will likely manufacture its 20th anniversary iPhone models in China, despite broader efforts to shift production to India, according to Bloomberg's Mark Gurman. In 2027, Apple is planning a "major shake-up" for the iPhone lineup to mark two decades since the original model launched. Gurman's previous reporting indicates the company will introduce a foldable iPhone alongside a "bold"...
apple watch ultra yellow

What's Next for the Apple Watch Ultra 3 and Apple Watch SE 3

Friday April 25, 2025 2:44 pm PDT by
This week marks the 10th anniversary of the Apple Watch, which launched on April 24, 2015. Yesterday, we recapped features rumored for the Apple Watch Series 11, but since 2015, the Apple Watch has also branched out into the Apple Watch Ultra and the Apple Watch SE, so we thought we'd take a look at what's next for those product lines, too. 2025 Apple Watch Ultra 3 Apple didn't update the...
AirPods Pro 3 Mock Feature

AirPods Pro 3 Just Months Away – Here's What We Know

Tuesday April 29, 2025 1:30 am PDT by
Despite being more than two years old, Apple's AirPods Pro 2 still dominate the premium wireless‑earbud space, thanks to a potent mix of top‑tier audio, class‑leading noise cancellation, and Apple's habit of delivering major new features through software updates. With AirPods Pro 3 widely expected to arrive in 2025, prospective buyers now face a familiar dilemma: snap up the proven...
iPhone 17 Pro Blue Feature Tighter Crop

iPhone 17 Pro Launching Later This Year With These 13 New Features

Wednesday April 23, 2025 8:31 am PDT by
While the iPhone 17 Pro and iPhone 17 Pro Max are not expected to launch until September, there are already plenty of rumors about the devices. Below, we recap key changes rumored for the iPhone 17 Pro models as of April 2025: Aluminum frame: iPhone 17 Pro models are rumored to have an aluminum frame, whereas the iPhone 15 Pro and iPhone 16 Pro models have a titanium frame, and the iPhone ...
iPhone 17 Pro on Desk Feature

All iPhone 17 Models Again Rumored to Feature 12GB of RAM

Tuesday April 29, 2025 3:36 am PDT by
All upcoming iPhone 17 models will come equipped with 12GB of RAM to support Apple Intelligence, according to the Weibo-based leaker Digital Chat Station. The claim from the Chinese leaker, who has sources within Apple's supply chain, comes a few days after industry analyst Ming-Chi Kuo said that the iPhone 17 Air, iPhone 17 Pro, and iPhone 17 Pro Max will all be equipped with 12GB of RAM. ...

Top Rated Comments

FactVsOpinion Avatar
103 months ago
It's one of these technologies where you just know there will amazing use cases and applications all over the place, but it's pretty hard to imagine many specific examples.
Score: 7 Votes (Like | Disagree)
Nevaborn Avatar
103 months ago
AR was always the dream. I knew Apple would nail it. From game interaction to customising home design and using the camera to view and find out information about the world around you.AR really is the next step in technology. VR has its place for games and entertainment but AR is a tool for every day life.
Score: 5 Votes (Like | Disagree)
Jeremy1026 Avatar
103 months ago
The technology is cool, but nothing practical that convinces me to spend $800 on a head set.
You're confusing VR (Virtual Reality, headsets) with AR (Augmented Reality, adding to the image on your screen).
Score: 4 Votes (Like | Disagree)
djcerla Avatar
103 months ago
This is the next gold rush.
Score: 4 Votes (Like | Disagree)
mi7chy Avatar
103 months ago
DRAM is going to limit the number and complexity of objects loaded along with a newer GPU required for decent performance. I can see needing the 2017 iPad Pros with 4GB DRAM and GPUs to have a positive experience.
Score: 3 Votes (Like | Disagree)
teh29 Avatar
103 months ago
Does anyone know how to get this demo? Is it on the developer portal? I can't seem to find it.
The code is available under "Resources" of this WWDC ARKit video...

https://developer.apple.com/videos/play/wwdc2017/602/
Score: 3 Votes (Like | Disagree)