Apple Releases ARKit 3.5 for Developers With Support for iPad Pro's LiDAR Scanner

Apple today informed developers that ARKit 3.5 is now available, with the update adding support for the LiDAR Scanner and depth-sensing system included in the new 11 and 12.9-inch iPad Pro models.


According to Apple, the new LiDAR Scanner will allow for a "new generation of AR apps" that use Scene Geometry for enhanced scene understanding and object occlusion.

Existing AR experiences on ‌iPad Pro‌ can also be improved with instant AR placement and improved Motion Capture and People Occlusion.

The LiDAR Scanner uses reflected light to measure the distance from the sensor to surrounding objects up to five meters away, indoors and outdoors. Depth frameworks in iPadOS combine depth points measured by the LiDAR Scanner, data from the two cameras, and data from motion sensors with computer vision algorithms handled by the A12Z Bionic to create a detailed and complete understanding of a scene.

At the current time, the new LiDAR Scanner with its enhanced augmented reality capabilities is limited to the new ‌iPad Pro‌ models, but Apple is also expected to include the feature in the 2020 iPhone models set to be released this fall.

Tag: ARKit

Top Rated Comments

(View all)
Avatar
14 weeks ago


I take Gimmicks the world doesn't need for $100, Alex

Always fun when people pass judgment based on their own internal subjective beliefs. But at least you didn't say that you polled all 8 of your friends and none were interested in it.
Score: 8 Votes (Like | Disagree)
Avatar
14 weeks ago

Thomas, post: 28306089, member: 1021539"]
But I guess the LiDAR should still help in normal AR applications as well, e.g. when it comes to detecting a surface. Currently this is done using the cameras and AI only. So, the LiDAR should be able to transparently assist that AI in current AR applications as well, or?
The question there would be: will it remove lag in AR applications? Last time I tried an AR app the stabilization of AR objects was imho too slow. For objects in space it doesn't really matter, but for objects supposed to be attached to or sitting on a surface it didn't really met my expectations...

Yes. The calibration step goes away.


Instant AR
The LiDAR Scanner on iPad Pro enables incredibly quick plane detection, allowing for the instant placement of AR objects in the real world without scanning. Instant AR placement is automatically enabled on iPad Pro for all apps built with ARKit, without any code changes.

Score: 5 Votes (Like | Disagree)
Avatar
14 weeks ago
This is all in preparation for their glasses. To gather real life data. iPhone next when devs have caught up.
Score: 3 Votes (Like | Disagree)
Avatar
14 weeks ago
I take Gimmicks the world doesn't need for $100, Alex
Score: 2 Votes (Like | Disagree)
Avatar
14 weeks ago


I take Gimmicks the world doesn't need for $100, Alex

Nineteen years ago that would have been: I'll take Who Needs 1,000 Songs in Your Pocket for $100, Alex.
Score: 2 Votes (Like | Disagree)
Avatar
14 weeks ago
people that say "but the 12Z chip is awful!" have no clue what it means to include an expensive lidar feature.
Score: 2 Votes (Like | Disagree)

Top Stories

Apple Officially Obsoletes First MacBook Pro With a Retina Display

Wednesday July 1, 2020 3:40 am PDT by
As expected, Apple's first MacBook Pro with a Retina display is now officially classed as "obsolete" worldwide, just over eight years after its release. In a support document, Apple notes that obsolete products are no longer eligible for hardware service, with "no exceptions." This means that any mid-2012 Retina MacBook Pro 15-inch models still out there that require a battery or other...

New Mac Ransomware Found in Pirated Mac Apps

Tuesday June 30, 2020 11:44 am PDT by
There's a new 'EvilQuest' Mac ransomware variant that's spreading through pirated Mac apps, according to a new report shared today by Malwarebytes. The new ransomware was found in pirated download for the Little Snitch app found on a Russian forum. Right from the point of download, it was clear that something was wrong with the illicit version of Little Snitch, as it had a generic installer...

Unreleased iMac With 10-Core Comet Lake-S Chip and Radeon Pro 5300 GPU Shows Up in Geekbench

Wednesday July 1, 2020 10:48 am PDT by
Benchmarks for an unreleased iMac equipped with a 10th-generation Core i9 Intel Comet Lake-S chip and an AMD Radeon Pro 5300 graphics card have surfaced, giving us an idea of what we can expect from a refreshed 2020 iMac. The Geekbench benchmarks, which appear to be legit, were found on Twitter and shared this morning by Tom's Hardware. The iMac in the benchmarks would be a successor to the...

Leaker: Future iPhone Models to Come in 'Exquisite' Thinner Box

Wednesday July 1, 2020 1:57 am PDT by
Leaker L0vetodream this morning posted a tweet corroborating recent rumors that Apple's "iPhone 12" lineup won't come with EarPods or a charger in the box, adding that this will also eventually apply to the existing second-generation iPhone SE. L0vetodream also claims that future iPhone packaging will be "thinner" and "exquisite," which would make sense if Apple's handsets are set to come in ...

Apple's A12Z Under Rosetta Outperforms Microsoft's Native Arm-Based Surface Pro X

Monday June 29, 2020 10:31 am PDT by
Apple's Developer Transition Kit equipped with an A12Z iPad Pro chip began arriving in the hands of developers this morning to help them get their apps ready for Macs running Apple Silicon, and though forbidden, the first thing some developers did was benchmark the machine. Multiple Geekbench results have indicated that the Developer Transition Kit, which is a Mac mini with an iPad Pro chip, ...

Kuo: iPhone 12 Models Won't Include Charger in Box, 20W Power Adapter Will Be Sold Separately

Sunday June 28, 2020 7:56 am PDT by
iPhone 12 models will not include EarPods or a power adapter in the box, analyst Ming-Chi Kuo said today in a research note obtained by MacRumors. This lines up with a prediction shared by analysts at Barclays earlier this week. Kuo said that Apple will instead release a new 20W power adapter as an optional accessory for iPhones and end production of its existing 5W and 18W power adapters...

Rosetta 2 Benchmarks Surface From Mac Mini With A12Z Chip

Monday June 29, 2020 7:48 am PDT by
While the terms and conditions for Apple's new "Developer Transition Kit" forbid developers from running benchmarks on the modified Mac mini with an A12Z chip, it appears that results are beginning to surface anyhow. Image Credit: Radek Pietruszewski Geekbench results uploaded so far suggest that the A12Z-based Mac mini has average single-core and multi-core scores of 811 and 2,781...

Display Analyst Once Again Says No 120Hz ProMotion Display Coming to iPhone 12 Pro

Wednesday July 1, 2020 11:29 am PDT by
Apple's iPhone 12 models will not feature an upgraded 120Hz ProMotion display, according to display analyst Ross Young. Young previously said that Apple would not implement ProMotion technology until it adopted low-power LTPO display technology, a move Apple is not expected to make until 2021. In a tweet shared this morning, Young said that the none of his contacts have been able to...

Apple Seeds Third Betas of iOS and iPadOS 13.6 to Developers [Update: Public Beta Available]

Tuesday June 30, 2020 10:06 am PDT by
Apple today seeded the third betas of upcoming iOS and iPadOS 13.6 updates to developers, three weeks after seeding the second betas and over a month after releasing iOS/iPadOS 13.5 with Exposure Notification API, Face ID updates, Group FaceTime changes, and more. iOS and iPadOS 13.6 can be downloaded from the Apple Developer Center or over the air once the proper developer profile has been...

The New York Times Ends Apple News Partnership and Pulls All Articles

Monday June 29, 2020 11:17 am PDT by
The New York Times today announced that it is pulling out of Apple News, as the service does not "align with its strategy of building direct relationships with paying readers." Starting today, articles from The New York Times will no longer show up in the Apple News app. The news site says that Apple has given it "little in the way of direct relationships with readers" and "little control...