Apple's Self-Driving Car Performance May Not Be So Bad After All

Apple's preliminary disengagement data for its self-driving car project surfaced yesterday pointing towards a high number of disengagements, and today, the DMV has shared the full disengagement reports from the company, providing more insight into Apple's autonomous car testing.

A disengagement report tracks the number of times an autonomous vehicle disengages and gives control back to a safety driver or the number of times the safety driver in the vehicle interferes.


Yesterday's information suggested Apple had the worst rank when it came to disengagements, but Apple has now provided details [PDF] explaining its disengagement reporting procedures and some changes that were made mid-year.

For the period between April 2017 and June 2018, Apple vehicles drove 24,604 miles autonomously and experienced 40,198 manual takeovers and 36,359 software disengagements, a number that is comparatively high based on disengagement reports from other companies.

As of July 2018, however, Apple stopped reporting its total number of disengagements and instead began focusing on "Important Disengagements," aka disengagements that might have resulted in a safety-related event (aka accident) or a violation of the rules of the road.

Using this metric, Apple vehicles have driven 56,135 miles since July 2018, with only 28 "Important Disengagements" reported. Two of these "Important Disengagements" were indeed minor collisions that weren't the fault of Apple's vehicles. One accident took place in August 2018 and the other was in October 2018.

Under Apple’s revised reporting threshold, the company’s cars experienced only one important disengagement every 2005 miles, compared to every 1.1 miles if the full data is counted. If other companies use similar thresholds to Apple’s new standard, Apple would rank much better.

Making direct comparisons between Apple's disengagement report and the results from other companies is difficult because there is no standard for reporting disengagements. It's up to each individual company to decide what constitutes a disengagement and what disengagements need to be reported.

It is clear, though, that Apple's vehicles are in the early stages of testing, as the company says itself in a DMV cover letter.

According to Apple, safety is its "highest priority" and its approach to disengagements is "conservative" because its system is not yet able to operate in "all conditions and situations."

Apple's testing parameters require drivers to proactively take manual control of a vehicle any time the system encounters a scenario beyond its current capabilities. The vehicle itself also self-monitors and returns control back to the driver when errors or issues are encountered.

Situations where drivers take over include the appearance of emergency vehicles, construction zones, or unexpected objects in the road, as Apple's vehicles cannot self-navigate these obstacles.

The autonomous software hands over control when it can't sufficiently track an object, is unable to generate a motion plan using the path planning system, when the vehicle systems don't respond as expected, and when there are communication issues.

Apple now has more than 62 vehicles out on the road, a number that will likely ramp up in 2019 as autonomous software testing continues. Apple is required to provide annual disengagement reports to the DMV, so we'll see the company's 2019 performance in early 2020, and will be able to look for improvements.

Related Roundup: Apple Car

Top Rated Comments

(View all)
Avatar
21 months ago
This makes more sense. All the nonsense people came up with the earlier report.... including apple is doomed, steve turning in his graves, tim is a big fail etc etc...
Score: 21 Votes (Like | Disagree)
Avatar
21 months ago

Apple Maps is not industry leader.

Siri is not industry leader.

If Apple can't lead on these, trying to twist the disengagement stats and trying to put Apple in a better light is not going to help anyone.

Stop dismissing the signs, Apple needs a huge wakeup call, switch up management, bring in new blood that has the tenacity and drive that Steve Jobs had, make Apple great again.

Somebody needs a wake up call and it isn’t Apple
Score: 18 Votes (Like | Disagree)
Avatar
21 months ago
So much like iPhone unit sales, the numbers weren't good so we stopped reporting them.
Score: 16 Votes (Like | Disagree)
Avatar
21 months ago
Apple Maps is not industry leader.

Siri is not industry leader.

If Apple can't lead on these, trying to twist the disengagement stats and trying to put Apple in a better light is not going to help anyone.

Stop dismissing the signs, Apple needs a huge wake up call, switch up management, bring in new blood that has the tenacity and drive that Steve Jobs had, make Apple great again.
Score: 10 Votes (Like | Disagree)
Avatar
21 months ago
I'm just going to leave this here...written here in the 'older' thread on this subject...

As a professional engineer in a different field, another factor that could be at play: the tolerance of the system to disengage will be different in each product.

Haters love to hate.

Score: 9 Votes (Like | Disagree)
Avatar
21 months ago

So much like iPhone unit sales, the numbers weren't good so we stopped reporting them.

They were at least 4 years late on that one. Samsung stopped reporting long ago and the others never reported. Why subject yourself to unnecessary scrutiny when you make 30 times more profit in a quarter than tech darlin’ Amazon and actually have proven you know how to transition to new markets with relative ease. Amazon doesn’t report unit sales either by the way.
Score: 7 Votes (Like | Disagree)

Top Stories

'iPhone 12 mini' Name Reappears in Leaked Apple iPhone 12 Case Stickers

Friday September 25, 2020 1:58 am PDT by
Earlier this week a proven leaker claimed that the iPhone 12 lineup would be named "iPhone 12 mini," "iPhone 12," "iPhone 12 Pro," and "iPhone 12 Pro Max," and today the same nomenclature has appeared again in a photo depicting alleged stickers from unreleased Silicone iPhone cases originating from Apple's international distribution center in Ireland. The photo shows three stickers with the...

New Images Leak of iPhone 12 Braided USB-C to Lightning Cable

Thursday September 24, 2020 2:37 am PDT by
Rumors suggest Apple's upcoming iPhone 12 models will ship with a new Lightning to USB-C cable that includes a braided fabric design. Images of the purported cables were leaked in July, and today leaker Mr White has shared new images that give us a closer look at what we might get included in the iPhone 12 box. The photos show a USB-C to Lightning cable with a clearly braided design rather...

New Version of Microsoft Office Coming Next Year That Won't Require a Subscription

Thursday September 24, 2020 1:53 am PDT by
Microsoft will next year offer a new perpetual release of Microsoft Office for Mac and Windows that doesn't require a subscription to use, according to the software giant (via Windows Central). "Microsoft Office will also see a new perpetual release for both Windows and Mac, in the second half of 2021," said Microsoft in a blog post announcing the next version of its Exchange server,...

Apple Releases iOS 14.0.1 With Fix for Bug That Resets Default Apps After Rebooting

Thursday September 24, 2020 10:12 am PDT by
Apple today released iOS 14.0.1, the first update to the iOS 14 operating system that was released on September 16. Today's update is a bug fix update addressing issues that weren't able to be fixed in the initial iOS 14 launch. The iOS 14.0.1 update is available on all eligible devices over-the-air in the Settings app. To access the new software, go to Settings > General > Software Update. ...

Apple's iPhone 12 Event Could Happen on October 13 Based on Rumors From Mobile Operators

Wednesday September 23, 2020 11:51 am PDT by
Apple's upcoming iPhone-centric event could perhaps be held on Tuesday, October 13, according to information shared with MacRumors by an employee at a UK cellular carrier. There's no way for us to confirm the dates at this point in time nor are we sure on the credibility of the source, but even without a rumor, Tuesday, October 13 is a good guess based on Apple's historic launch timelines, ...

Apple Releases macOS Catalina 10.15.7 With Fixes for WiFi Bug, 27-Inch iMac Graphics Issues

Thursday September 24, 2020 10:32 am PDT by
Apple today released macOS Catalina 10.15.7, the latest update to the macOS Catalina software. macOS Catalina 10.15.7 fixes several major bugs that Mac users have been experiencing, and it comes a month after the latest macOS Catalina release. The ‌‌‌macOS Catalina‌‌‌ 10.15.6 Supplemental Update can be downloaded from the Mac App Store using the Update feature in the System...

Apple Designs Custom Face Mask for Corporate and Retail Employees [Updated with Unboxing]

Wednesday September 9, 2020 11:13 am PDT by
Apple's design team has created a new kind of protective mask that's being distributed to retail and corporate employees, reports Bloomberg. The mask is called the Apple Face Mask and it was developed in-house in Cupertino by the Engineering and Industrial Design teams at Apple. Last week, an Apple employee sent MacRumors an image of the mask design, which can be seen up above. The Apple ...

Video Offers Closer Look at Apple Face Mask

Friday September 25, 2020 5:25 am PDT by
YouTube channel Unbox Therapy has today shared a new video giving a closer look at Apple's reusable face masks for corporate and retail employees. Apple's own face mask was designed by the company's Engineering and Industrial Design teams amid the global health crisis for corporate and retail employees, and the boxes include Apple's famous "Designed by Apple in California" text. The...

Top Stories: iOS 14 Feature Tour, 'iPhone 12 mini' Rumors, Apple Watch Band Controversy

Saturday September 26, 2020 6:00 am PDT by
Things started to calm down a bit this week following last week's rush of media event, Apple Watch and iPad launches, and the release of iOS 14 and other operating updates. But that doesn't mean there wasn't still a lot of news, from digging deeper into iOS 14 to more iPhone 12 rumors to the uproar over trying to exchange band sizes on the new Apple Watch. On top of all of that, we heard...

Interest in iOS 14 Home Screen Ideas Helps Pinterest Break Daily Download Record

Wednesday September 23, 2020 4:37 am PDT by
Apple's introduction of widgets on the Home Screen in iOS 14 has driven a surge in interest among users looking to customize their iPhone, and that has reportedly had a knock-on effect for Pinterest, whose iOS app has seen record downloads as users flock to its content seeking design inspiration. As reported by TechCrunch, App Store intelligence firm Apptopia was first to note the impact of ...