Apple Releases ARKit 3.5 for Developers With Support for iPad Pro's LiDAR Scanner

Apple today informed developers that ARKit 3.5 is now available, with the update adding support for the LiDAR Scanner and depth-sensing system included in the new 11 and 12.9-inch iPad Pro models.

appleipadproar
According to Apple, the new LiDAR Scanner will allow for a "new generation of AR apps" that use Scene Geometry for enhanced scene understanding and object occlusion.

Existing AR experiences on ‌iPad Pro‌ can also be improved with instant AR placement and improved Motion Capture and People Occlusion.

The LiDAR Scanner uses reflected light to measure the distance from the sensor to surrounding objects up to five meters away, indoors and outdoors. Depth frameworks in iPadOS combine depth points measured by the LiDAR Scanner, data from the two cameras, and data from motion sensors with computer vision algorithms handled by the A12Z Bionic to create a detailed and complete understanding of a scene.

At the current time, the new LiDAR Scanner with its enhanced augmented reality capabilities is limited to the new ‌iPad Pro‌ models, but Apple is also expected to include the feature in the 2020 iPhone models set to be released this fall.

Tag: ARKit

Top Rated Comments

az431 Avatar
18 months ago

I take Gimmicks the world doesn't need for $100, Alex
Always fun when people pass judgment based on their own internal subjective beliefs. But at least you didn't say that you polled all 8 of your friends and none were interested in it.
Score: 8 Votes (Like | Disagree)
chucker23n1 Avatar
18 months ago
Thomas, post: 28306089, member: 1021539"]
But I guess the LiDAR should still help in normal AR applications as well, e.g. when it comes to detecting a surface. Currently this is done using the cameras and AI only. So, the LiDAR should be able to transparently assist that AI in current AR applications as well, or?
The question there would be: will it remove lag in AR applications? Last time I tried an AR app the stabilization of AR objects was imho too slow. For objects in space it doesn't really matter, but for objects supposed to be attached to or sitting on a surface it didn't really met my expectations...
Yes. The calibration step goes away.

Instant AR
The LiDAR Scanner on iPad Pro enables incredibly quick plane detection, allowing for the instant placement of AR objects in the real world without scanning. Instant AR placement is automatically enabled on iPad Pro for all apps built with ARKit, without any code changes.
Score: 5 Votes (Like | Disagree)
Defender2010 Avatar
18 months ago
This is all in preparation for their glasses. To gather real life data. iPhone next when devs have caught up.
Score: 3 Votes (Like | Disagree)
calstanford Avatar
18 months ago
I take Gimmicks the world doesn't need for $100, Alex
Score: 2 Votes (Like | Disagree)
citysnaps Avatar
18 months ago

I take Gimmicks the world doesn't need for $100, Alex
Nineteen years ago that would have been: I'll take Who Needs 1,000 Songs in Your Pocket for $100, Alex.
Score: 2 Votes (Like | Disagree)
farewelwilliams Avatar
18 months ago
people that say "but the 12Z chip is awful!" have no clue what it means to include an expensive lidar feature.
Score: 2 Votes (Like | Disagree)

Top Stories

iOS 14 on iPhone feature emergency

Apple Releases iOS and iPadOS 14.7.1 With Fix for Touch ID Apple Watch Bug

Monday July 26, 2021 9:48 am PDT by
Apple today released iOS and iPadOS 14.7.1, minor bug fix updates that come just a week after the release of iOS 14.7, software that introduced new Apple Card features and support for the MagSafe Battery Pack. The iOS and iPadOS 14.7.1 updates can be downloaded for free and the software is available on all eligible devices over-the-air in the Settings app. To access the new software, go to...
iPad mini pro feature 2

iPad Mini 6 to Feature 8.3-Inch Display With No Home Button and Narrower Bezels

Monday July 26, 2021 12:26 pm PDT by
The sixth-generation iPad mini that's in the works will have an 8.3-inch display, according to display analyst Ross Young. That will be larger than the current 7.9-inch display, with the larger size due to the removal of the Home button and a narrower bezel design. Rumors about the iPad mini 6 have been picking up in recent weeks ahead of its prospective launch this fall. Apple analyst...
iphone 12 pro gold

Report: iPhone 14 Pro Models to Feature Tough Titanium Alloy Chassis

Monday July 26, 2021 1:12 am PDT by
Next year's "iPhone 14" series is expected to feature high-end models with a new titanium alloy chassis design, claims a new investors report by JP Morgan Chase. According to the report, the use of titanium alloy will be one of the biggest changes to the case design in the 2022 iPhone series, and Foxconn will be the exclusive manufacturer of the titanium frames for the high-end models....
nothing ear 1 buds 1

Nothing 'Ear (1)' True Wireless Earbuds Launch to Take on AirPods Pro With ANC and Unusual Design for $99

Tuesday July 27, 2021 7:57 am PDT by
Nothing, a new brand from OnePlus founder Carl Pei, has today officially launched the "Ear (1)" true wireless earbuds after months of anticipation around the company's AirPods Pro rival. The Ear (1) features an in-ear design, Active Noise Cancelation, Bluetooth 5.2, IPX4 water resistance, and a charging case with Qi-compatible wireless charging and a USB-C port. Fast pairing is supported on...
apple mac business page

Apple Shares 11 Reasons Why Business Users Should Choose Macs

Monday July 26, 2021 11:35 am PDT by
Apple today updated its Apple at Work website with a new section dedicated to the Mac, which offers up 11 reasons why "Mac means business." On the webpage, Apple highlights the M1 chip as the number one reason why business users should choose a Mac, offering up an M1 overview [PDF] that explains the benefits of the M1 chip. The information isn't new, but it does provide a look at all of...
imac with accessories

Larger Redesigned High-End iMac Rumored to Launch Next Year

Monday July 26, 2021 3:45 am PDT by
Apple's larger redesigned iMac will arrive sometime in 2022 rather than later this year, according to the leaker known as "Dylandkt." On Twitter, Dylandkt claimed that Apple's "high end iMac" is not expected to release in the fourth quarter of 2021 alongside Apple's "M1X Macs" – a reference to Apple's redesigned MacBook Pro models – because "Apple simply does not want their devices to...
General iOS 14

iOS 14.7.1 and macOS Big Sur 11.5.1 Patch Security Vulnerability That May Have Been Actively Exploited

Monday July 26, 2021 11:55 am PDT by
Apple today released unexpected iOS 14.7.1 and iPadOS 14.7.1 updates to the public, and according to a newly released support document, the software addresses a serious security vulnerability that may have been exploited in the wild. Apple says that an application may have been able to execute arbitrary code with kernel privileges due to a memory corruption issue. "Apple is aware of a report ...
apple bitcoin hack

Is Apple Really Buying Bitcoin?

Monday July 26, 2021 3:07 am PDT by
A large number of websites and posts on social media are stoking rumors that Apple has purchased $2.5 billion worth of bitcoin in the company's first move into cryptocurrency, but is there any validity to the claims? Many people are citing the fact that Apple was looking for a Business Development Manager with experience in alternative payments, including cryptocurrency, earlier this year as ...
tesla red orange bg feature

Tesla CEO Elon Musk Takes Shots at Apple During Earnings Call

Monday July 26, 2021 4:53 pm PDT by
During a Tesla earnings call that took place today, Tesla CEO Elon Musk spent time sniping at Apple, reports CNBC. Musk criticized Apple's "walled garden" and made comments on the company's cobalt use. In a discussion about plans to allow Tesla competitors to use the Tesla electric vehicle charger network, Musk said that Tesla does not want to create a walled garden to "bludgeon" Tesla...
FaceID iMac REREREREMIX

Gurman: Face ID on the Mac Coming Within a 'Couple of Years'

Sunday July 25, 2021 7:09 am PDT by
Apple plans to bring Face ID to the Mac within the next "couple of years," respected Bloomberg journalist Mark Gurman said today in the latest edition of his Power On newsletter. In the newsletter, Gurman says that he believes Apple's ultimate goal is to shift all of its products to Face ID, including the lower-end iPhones such as the iPhone SE and the iPad Air, which feature Touch ID....