Apple Shares Research into Self-Driving Car Software That Improves Obstacle Detection

Apple computer scientists working on autonomous vehicle technology have posted a research paper online describing how self-driving cars can spot cyclists and pedestrians using fewer sensors (via Reuters).

The paper by Yin Zhou and Oncel Tuzel was submitted to the moderated scientific pre-print repository arXiv on November 17, in what appears to be Apple's first publicly disclosed research on autonomous vehicle technology.


The paper is titled "End-to-End Learning for Point Cloud Based 3D Object Detection", and describes how new software developed by Apple scientists improves the ability of LiDAR (Light Detection and Ranging) systems to recognize objects including pedestrians and cyclists from a distance.

Self-driving cars typically use a combination of standard cameras and depth-sensing LiDAR units to receive information about the world around them.

Apple's research team said they were able to get "highly encouraging results" using LiDAR data alone to spot cyclists and pedestrians, and wrote that they were also able to beat other approaches for detecting 3D objects that rely solely on LiDAR tech. The experiments were limited to computer simulations and did not advance to road tests.

Apple famously has a secretive research policy and has kept its work under wraps for many years, but over the last 12 months, the company has shared some of its research advancements with other researchers and the wider public, particularly in the area of machine learning.

In December 2016, Apple said that it would start allowing its AI and machine learning researchers to publish and share their work in papers, with the first paper appearing just a few weeks following the announcement.

Additionally, in July of this year, Apple researchers initiated the "Apple Machine Learning Journal", a blog detailing their work on machine learning, AI, and other related topics.

This new policy of openness could help Apple retain employees who do not want to keep their progress a secret, but the latest research into autonomous vehicle technology also lets regulators see that the company is making progress in this area. Last December, Apple told federal regulators it was excited about the technology and asked them not to restrict testing. In April, the company also filed a self-driving car testing plan with California regulators.

Apple CEO Tim Cook has called autonomy "the mother of all AI projects". During an August 2017 earnings call, Cook re-emphasized Apple's deep interest in the technology, and even hinted Apple's work on autonomy could be used for more than vehicles.

Apple has presumably been working on an autonomous driving system since 2014, when rumors of its efforts to create an electric vehicle first surfaced. Apple has now moved away from creating a full vehicle and is said to be focusing on self-driving technology instead.

Related Roundup: Apple Car

Top Rated Comments

(View all)
Avatar
37 months ago
This is good for everyone. Apple sharing this research instead of keeping it proprietary shows they are more interested in getting to a sustainable future faster than retaining whatever competitive business advantage this would give them.
Score: 8 Votes (Like | Disagree)
Avatar
37 months ago
Why are they making these? Who has ever asked for self driving cars?

We wanted FLYING cars, I think they got this mixed up somewhere.
Score: 7 Votes (Like | Disagree)
Avatar
37 months ago

check your stats: sad but not millions—fewer than 40,000 deaths per year, “only” 3.6 million 1899-2013, according to National Traffic Safety Transportation Bd.

FYI: US is not the only country on Earth.
http://asirt.org/initiatives/informing-road-users/road-safety-facts/road-crash-statistics

* Nearly 1.3 million people die in road crashes each year, on average 3,287 deaths a day.
* An additional 20-50 million are injured or disabled.
Score: 5 Votes (Like | Disagree)
Avatar
37 months ago


We wanted FLYING cars, I think they got this mixed up somewhere.

And I wouldn't say no to a time machine, so I can bring back an almanac, get rich and finally be able to afford the new iMac pro
Score: 5 Votes (Like | Disagree)
Avatar
37 months ago

Why are they making these? Who has ever asked for self driving cars?

We wanted FLYING cars, I think they got this mixed up somewhere.

One step at a time.
And who asked for self driving cars? Since humans are quite good at causing terrible accidents on the road that costs the life of millions each year, self driving car seems the logical solution. Who wouldn't want to minimise the road accidents?
Score: 4 Votes (Like | Disagree)
Avatar
37 months ago

check your stats: sad but not millions—fewer than 40,000 deaths per year, “only” 3.6 million 1899-2013, according to National Traffic Safety Transportation Bd.

that said—I am not yet crazy about self-driving cars either. Daughter and son-in-law were backseat passengers in vehicle with self-driving engaged that “failed to see” highway exit barrier and would have crashed but for host’s screaming shotgun-riding wife.

You most be one of them that thinks US is the entire world. Here ('http://asirt.org/initiatives/informing-road-users/road-safety-facts/road-crash-statistics')
And I was talking about how it effects the millions of others life, the injured.
And of course, a single or maybe few accidents on a beta testing self driving cars of the future is a clear indication of capabilities if this technology. Nothing compare with the human madness on the road.
[doublepost=1511358366][/doublepost]


Careful what you ask for..... quite a few plan crashes were attributed to automation . Sadly human can adapt and react to situations, when a computer encounters an edge case the consequences can be tragic be it a plane or car.

It is a beta testing technology that can be improved beyond what we even think it is possible today.
And thank you, but I don't trust humans on the road. I have seen quite enough. Can't wait to see the day driving on the road becomes illegal (if in my lifetime)
Score: 4 Votes (Like | Disagree)

Top Stories

Here's How You Can Download iOS 14 and iPadOS 14 Around the World [It's Out]

Wednesday September 16, 2020 2:36 am PDT by
Apple's official public release of iOS 14 and iPadOS 14 dropped on Wednesday, September 16, just a day after the company released the Golden Master to third-party developers. Also set to be made available to the general public for the first time are watchOS 7 and tvOS 14. Getting Started With iOS 14 Video Click image to watch iOS 14 Getting Started While that's left a lot of developers...

When Will the iPhone 12 Launch? Here's What We Know

Wednesday September 16, 2020 6:12 am PDT by
Yesterday's "Time Flies" Apple event saw the release of the Apple Watch Series 6, Apple Watch SE, iPad 8, and iPad Air 4, but no new iPhone models. Rumors before the event strongly alleged that it would not see the unveiling of new iPhones, with many reports pointing to an October launch. The lack of new iPhone models yesterday seems to confirm that the iPhone 12 lineup will not appear...

Apple Releases iOS 14 and iPadOS 14 With Home Screen Redesign, App Library, Compact UI, Translate App, Scribble Support, App Clips, and More

Wednesday September 16, 2020 12:48 pm PDT by
Apple has released iOS 14 and iPadOS 14, the newest operating system updates designed for the iPhone and iPad. As with all of Apple's software updates, iOS 14 and iPadOS 14 can be downloaded for free. iOS 14 is available on the iPhone 6s and later, while iPadOS 14 is available on the iPad Air 2 and later. The updates are available on all eligible devices over-the-air in the Settings app. To ...

Apple Releases Safari 14 for Mac Ahead of macOS Big Sur Launch

Wednesday September 16, 2020 1:40 pm PDT by
macOS Big Sur didn't launch alongside iOS 14, iPadOS 14, tvOS 14, and watchOS 7 today, with the update coming later this fall, but Apple did release the Safari 14 update for macOS Catalina and macOS Mojave users. Safari 14 brings improved performance, customizable start pages, a Privacy Report to see which cross-site trackers are being blocked, and a new tab bar design that provides tab...

Apple Updates AirPods 2 and AirPods Pro Firmware to Version 3A283

Monday September 14, 2020 11:24 am PDT by
Apple today released new 3A283 firmware updates for the second-generation AirPods and the AirPods Pro. The second-generation AirPods are being updated from the 2D15 firmware they were previously running, while the AirPods Pros are being updated from the 2D27 firmware they had installed previously. Apple does not provide details on what's included in refreshed firmware so we don't know what's ...

iOS 14 Picture in Picture No Longer Working With YouTube's Mobile Website in Safari [Without Premium]

Friday September 18, 2020 12:21 pm PDT by
Apple in iOS 14 added Picture in Picture to the iPhone, a feature designed to let you watch a video in a small screen on your device while you continue to do other things on the phone. When Picture in Picture was working with YouTube The YouTube app doesn't support Picture in Picture, but up until yesterday there was a functional workaround that allowed videos from YouTube.com to be watched...

Hands-On With the New Apple Watch Series 6 and Apple Watch SE

Friday September 18, 2020 1:19 pm PDT by
Today's the official launch date for the Apple Watch Series 6 and the Apple Watch SE, both of which Apple announced on Tuesday. We picked up a couple of the new models and thought we'd give them a quick look for MacRumors readers thinking of ordering a new watch. Apple Watch Series 6 & Apple Watch SE Hands-On! When it comes to design, both the $399 Series 6 and the $279 SE look just like...

iOS 14.2 Beta Adds New Shazam Music Recognition Feature for Control Center

Thursday September 17, 2020 3:36 pm PDT by
Apple today released the first beta of iOS 14.2 to developers for testing purposes, and the new update introduces a Music Recognition control for the Control Center. The new feature lets you discover music playing around you and it recognizes the music playing with in apps, even when you're wearing AirPods. Songs pop up as notifications, and you can tap to listen in Apple Music....

8 Third-Party Home Screen Widgets That You Can Try Out Now on iOS 14

Wednesday August 5, 2020 12:56 pm PDT by
One of the biggest new features of iOS 14 is Home Screen widgets, which provide information from apps at a glance. The widgets can be pinned to the Home Screen in various spots and sizes, allowing for many different layouts. When the iOS 14 beta was first released in June, widgets were limited to Apple's own apps like Calendar and Weather, but several third-party developers have begun to test ...

Apple Releases watchOS 7 With New Watch Faces, Family Setup, Sleep Tracking, Handwashing Help and More

Wednesday September 16, 2020 12:47 pm PDT by
Apple today released watchOS 7, the newest version of the watchOS operating system designed to run on modern Apple Watch models. The watchOS 7 update comes after several months of beta testing. ‌watchOS 7‌ can be downloaded for free through the dedicated Apple Watch app on the iPhone by going to General > Software Update. To install the new software, the Apple Watch needs to have at...