Apple Announces ARKit 4 with Location Anchors, Depth API, and Improved Face Tracking

Apple today announced ARKit 4 alongside iOS 14 and iPadOS 14. The new version of ARKit introduces Location Anchors, a new Depth API, and improved face tracking.

ARKit 4
Location Anchors allow developers to place AR experiences, such as life‑size art installations or navigational directions, at a fixed destination. Location Anchoring leverages the higher-resolution data in Apple Maps to place AR experiences at a particular point in the world, meaning AR experiences may now be placed at specific locations, such as throughout cities or alongside famous landmarks. Users can move around virtual objects and observe them from different perspectives, exactly as real objects are seen through a camera lens.

ARKit 4 also takes advantage of iPad Pro's LiDAR Scanner with a brand-new Depth API with advanced scene understanding capabilities, creating a new way to access detailed per-pixel depth information. When combined with 3D mesh data, this depth information makes virtual object occlusion more realistic by enabling instant placement of virtual objects within their physical surroundings. This can offer new capabilities for developers, such as taking more precise measurements and applying effects to the environment.

Finally, face tracking is expanded in ARKit 4 to support the front-facing camera on all devices with the A12 Bionic chip or newer. Up to three faces may now be tracked at once using the TrueDepth camera to power front-facing camera experiences like Memoji and Snapchat.

Tag: ARKit

Top Rated Comments

Nicky G Avatar
25 months ago
It's funny that this "small" piece of WWDC news will go down, I reckon, as some of the most revolutionary stuff Apple announced this year, well beyond switching to ARM. It will take a few more years before it becomes more obvious, but when the "AR kit" that "ARKit" was designed for from the get-go eventually drops, it is going to have some very well-fleshed-out tech baked into it, stuff Apple has been "testing" out in the open for years now. Both via ARKit, and lots of other little things, such as Ultrawideband, early embrace of bluetooth beacon technology, etc. Science fiction has been describing this stuff (in terms of "fully-realized AR") since at least as far back as the early 90s, in Snow Crash. We're getting very close!
Score: 2 Votes (Like | Disagree)

Popular Stories

anker 563 dock ports

Anker's Latest USB-C Docking Station Brings Triple-Display Support to M1 Macs

Wednesday May 18, 2022 7:06 am PDT by
While Apple's early M1-based Macs can only officially support a single external display, there are ways around the limitation. Anker is launching a new 10-in-1 USB-C docking station today which delivers just that. The Anker 563 USB-C dock includes two HDMI ports and a DisplayPort port, and it leverages DisplayLink to carry multiple video signals over a single connection. Given that this hub...
Prosser Series 8 3

Apple Watch Series 8 Rumored to Feature New Design With Flat Display

Wednesday May 18, 2022 6:21 am PDT by
The Apple Watch Series 8 could feature an all-new design with a flat display, according to the leaker known as "ShrimpApplePro." In his latest video on the YouTube channel Front Page Tech, Jon Prosser highlighted information from ShrimpApplePro that suggests the Apple Watch Series 8 could feature a flat display in what seems to be a design originally rumored for the Apple Watch Series 7. ...
apple ar headset concept 1

Apple's Headset Said to Feature 14 Cameras Enabling Lifelike Avatars, Jony Ive Has Remained Involved With Design

Friday May 20, 2022 6:50 am PDT by
Earlier this week, The Information's Wayne Ma outlined struggles that Apple has faced during the development of its long-rumored AR/VR headset. Now, in a follow-up report, he has shared several additional details about the wearable device. Apple headset render created by Ian Zelbo based on The Information reporting For starters, one of the headset's marquee features is said to be lifelike...
apple data auction iphone privacy ad

Apple Highlights iPhone's Latest Privacy Features in New 'Data Auction' Ad

Wednesday May 18, 2022 9:00 am PDT by
Apple today shared a new ad highlighting iPhone privacy features like App Tracking Transparency and Mail Privacy Protection that are designed to give users more transparency and control when it comes to their personal data being collected. The ad revolves around a young woman named Ellie who discovers that her personal data is being sold at an auction house, with bids being placed on her...
apple ar headset concept 2

Apple's AR/VR Headset Nearing Completion as Board Gets Demo

Thursday May 19, 2022 9:52 am PDT by
Apple last week demonstrated its upcoming AR/VR headset to Apple board members, indicating that the device is in an advanced stage of development and could see a debut in the not too distant future, reports Bloomberg. Apple has also ramped up development of the software that runs on the headset, with that software expected to be called "RealityOS," or rOS for short. Render via designer Ian ...