Apple's Self-Driving Car Performance May Not Be So Bad After All

Apple's preliminary disengagement data for its self-driving car project surfaced yesterday pointing towards a high number of disengagements, and today, the DMV has shared the full disengagement reports from the company, providing more insight into Apple's autonomous car testing.

A disengagement report tracks the number of times an autonomous vehicle disengages and gives control back to a safety driver or the number of times the safety driver in the vehicle interferes.

lexussuvselfdriving2
Yesterday's information suggested Apple had the worst rank when it came to disengagements, but Apple has now provided details [PDF] explaining its disengagement reporting procedures and some changes that were made mid-year.

For the period between April 2017 and June 2018, Apple vehicles drove 24,604 miles autonomously and experienced 40,198 manual takeovers and 36,359 software disengagements, a number that is comparatively high based on disengagement reports from other companies.

As of July 2018, however, Apple stopped reporting its total number of disengagements and instead began focusing on "Important Disengagements," aka disengagements that might have resulted in a safety-related event (aka accident) or a violation of the rules of the road.

Using this metric, Apple vehicles have driven 56,135 miles since July 2018, with only 28 "Important Disengagements" reported. Two of these "Important Disengagements" were indeed minor collisions that weren't the fault of Apple's vehicles. One accident took place in August 2018 and the other was in October 2018.

Under Apple’s revised reporting threshold, the company’s cars experienced only one important disengagement every 2005 miles, compared to every 1.1 miles if the full data is counted. If other companies use similar thresholds to Apple’s new standard, Apple would rank much better.

Making direct comparisons between Apple's disengagement report and the results from other companies is difficult because there is no standard for reporting disengagements. It's up to each individual company to decide what constitutes a disengagement and what disengagements need to be reported.

It is clear, though, that Apple's vehicles are in the early stages of testing, as the company says itself in a DMV cover letter.

According to Apple, safety is its "highest priority" and its approach to disengagements is "conservative" because its system is not yet able to operate in "all conditions and situations."

Apple's testing parameters require drivers to proactively take manual control of a vehicle any time the system encounters a scenario beyond its current capabilities. The vehicle itself also self-monitors and returns control back to the driver when errors or issues are encountered.

Situations where drivers take over include the appearance of emergency vehicles, construction zones, or unexpected objects in the road, as Apple's vehicles cannot self-navigate these obstacles.

The autonomous software hands over control when it can't sufficiently track an object, is unable to generate a motion plan using the path planning system, when the vehicle systems don't respond as expected, and when there are communication issues.

Apple now has more than 62 vehicles out on the road, a number that will likely ramp up in 2019 as autonomous software testing continues. Apple is required to provide annual disengagement reports to the DMV, so we'll see the company's 2019 performance in early 2020, and will be able to look for improvements.

Related Roundup: Apple Car

Top Rated Comments

thasan Avatar
54 months ago
This makes more sense. All the nonsense people came up with the earlier report.... including apple is doomed, steve turning in his graves, tim is a big fail etc etc...
Score: 21 Votes (Like | Disagree)
A MacBook lover Avatar
54 months ago
Apple Maps is not industry leader.

Siri is not industry leader.

If Apple can't lead on these, trying to twist the disengagement stats and trying to put Apple in a better light is not going to help anyone.

Stop dismissing the signs, Apple needs a huge wakeup call, switch up management, bring in new blood that has the tenacity and drive that Steve Jobs had, make Apple great again.
Somebody needs a wake up call and it isn’t Apple
Score: 18 Votes (Like | Disagree)
Scottsoapbox Avatar
54 months ago
So much like iPhone unit sales, the numbers weren't good so we stopped reporting them.
Score: 16 Votes (Like | Disagree)
trifid Avatar
54 months ago
Apple Maps is not industry leader.

Siri is not industry leader.

If Apple can't lead on these, trying to twist the disengagement stats and trying to put Apple in a better light is not going to help anyone.

Stop dismissing the signs, Apple needs a huge wake up call, switch up management, bring in new blood that has the tenacity and drive that Steve Jobs had, make Apple great again.
Score: 10 Votes (Like | Disagree)
FireArse Avatar
54 months ago
I'm just going to leave this here...written here in the 'older' thread on this subject...

As a professional engineer in a different field, another factor that could be at play: the tolerance of the system to disengage will be different in each product.

Haters love to hate.
Score: 9 Votes (Like | Disagree)
genovelle Avatar
54 months ago
So much like iPhone unit sales, the numbers weren't good so we stopped reporting them.
They were at least 4 years late on that one. Samsung stopped reporting long ago and the others never reported. Why subject yourself to unnecessary scrutiny when you make 30 times more profit in a quarter than tech darlin’ Amazon and actually have proven you know how to transition to new markets with relative ease. Amazon doesn’t report unit sales either by the way.
Score: 7 Votes (Like | Disagree)

Popular Stories

iOS 16

iOS 16.4 Now Available for Your iPhone With These 8 New Features

Friday March 31, 2023 8:55 am PDT by
Following six weeks of beta testing, iOS 16.4 was released to the public this week. The software update includes a handful of new features and changes for the iPhone 8 and newer. To install an iOS update, open the Settings app on the iPhone, tap General → Software Update, and follow the on-screen instructions. Below, we have recapped eight new features and changes added with iOS 16.4,...
CarPlay Phone Call

General Motors to Phase Out Apple CarPlay Starting This Year in EV Transition

Friday March 31, 2023 8:43 am PDT by
General Motors (GM) will phase out Apple CarPlay and Android Auto in its vehicles starting this year, shifting to a built-in infotainment system co-developed with Google (via Reuters). GM owns Buick, Cadillac, Chevrolet, and GMC in the United States. It will stop offering Apple CarPlay and Android Auto starting with the 2024 Chevrolet Blazer, which goes on sale this summer. The company plans ...
iOS 17 on Phone Feature

Three New iOS Features Coming to Your iPhone Following Apple Music Classical

Thursday March 30, 2023 7:13 am PDT by
With the Apple Music Classical app and an Apple Pay Later early access program now available, the list of previously-announced iOS features that have yet to launch is beginning to shrink. However, there are still a few features we are waiting for. Below, we have recapped three more iOS features that are expected to launch in 2023, including an Apple Card savings account for Daily Cash,...
wwdc 2023

Three Products We Might See at WWDC 2023

Friday March 31, 2023 3:37 pm PDT by
Apple this week announced the official dates for the 34th annual Worldwide Developers Conference, with the annual WWDC keynote event set to take place on Monday, June 5. The keynote is where Apple unveils new versions of iOS, macOS, watchOS, and tvOS, and sometimes, we get hardware announcements. Rumors this year suggest there are at least three new devices that are set to be unveiled in the ...
iPhone 15 Pro Multi Purpose button Mute Switch Feature Green 2

iPhone 15 Pro Solid-State Button Sensitivity Can Be Customized to Cater for Cases and Gloves

Thursday March 30, 2023 11:36 pm PDT by
iPhone 15 Pro and iPhone 15 Pro Max users will be able to customize the sensitivity of the solid-state buttons on their device, thanks to a new sensitivity toggle in Settings. That's according to details provided by a hitherto reliable source that shared additional details on the MacRumors forums. Earlier this week, the same anonymous tipster revealed that the iPhone 15 Pro models will use...
apple mixed reality headset concept by david lewis and marcus kane

Kuo: Apple Mixed-Reality Headset May Not Appear at WWDC as Mass Production Pushed Back Yet Again

Thursday March 30, 2023 4:50 am PDT by
Apple has again pushed back mass production of its mixed-reality headset and the device may not appear at this year's Worldwide Developers Conference (WWDC), Apple analyst Ming-Chi Kuo today said. Apple headset concept by David Lewis and Marcus Kane In a tweet, Kuo explained that Apple "isn't very optimistic" about whether the headset will be able to create an "iPhone moment." As a result,...
iPhone 15 Pro Periscope Mock Feature

Periscope Camera Lens Exclusive to iPhone 15 Pro Max Will Be Supplied by Largan

Thursday March 30, 2023 1:18 am PDT by
The periscope camera lens that will be exclusive to the iPhone 15 Pro Max will be solely supplied by Largan, according to the 相機鏡頭中獲利-apple-camera-lens-suppliers-face-two-risks-high-53db8da990b2">latest no by Apple industry analyst Ming-Chi Kuo. Rumors about the iPhone getting a periscope lens have been circulating since early 2020, when Kuo first mentioned the possibility. The analyst...