Apple Shares Research into Self-Driving Car Software That Improves Obstacle Detection

Apple computer scientists working on autonomous vehicle technology have posted a research paper online describing how self-driving cars can spot cyclists and pedestrians using fewer sensors (via Reuters).

The paper by Yin Zhou and Oncel Tuzel was submitted to the moderated scientific pre-print repository arXiv on November 17, in what appears to be Apple's first publicly disclosed research on autonomous vehicle technology.

appleautonomousdrivingtestlexus
The paper is titled "End-to-End Learning for Point Cloud Based 3D Object Detection", and describes how new software developed by Apple scientists improves the ability of LiDAR (Light Detection and Ranging) systems to recognize objects including pedestrians and cyclists from a distance.

Self-driving cars typically use a combination of standard cameras and depth-sensing LiDAR units to receive information about the world around them.

Apple's research team said they were able to get "highly encouraging results" using LiDAR data alone to spot cyclists and pedestrians, and wrote that they were also able to beat other approaches for detecting 3D objects that rely solely on LiDAR tech. The experiments were limited to computer simulations and did not advance to road tests.

Apple famously has a secretive research policy and has kept its work under wraps for many years, but over the last 12 months, the company has shared some of its research advancements with other researchers and the wider public, particularly in the area of machine learning.

In December 2016, Apple said that it would start allowing its AI and machine learning researchers to publish and share their work in papers, with the first paper appearing just a few weeks following the announcement.

Additionally, in July of this year, Apple researchers initiated the "Apple Machine Learning Journal", a blog detailing their work on machine learning, AI, and other related topics.

This new policy of openness could help Apple retain employees who do not want to keep their progress a secret, but the latest research into autonomous vehicle technology also lets regulators see that the company is making progress in this area. Last December, Apple told federal regulators it was excited about the technology and asked them not to restrict testing. In April, the company also filed a self-driving car testing plan with California regulators.

Apple CEO Tim Cook has called autonomy "the mother of all AI projects". During an August 2017 earnings call, Cook re-emphasized Apple's deep interest in the technology, and even hinted Apple's work on autonomy could be used for more than vehicles.

Apple has presumably been working on an autonomous driving system since 2014, when rumors of its efforts to create an electric vehicle first surfaced. Apple has now moved away from creating a full vehicle and is said to be focusing on self-driving technology instead.

Popular Stories

m5 macbook pro deal

Why You Shouldn't Buy the Next MacBook Pro

Tuesday February 10, 2026 4:27 pm PST by
Apple is planning to launch new MacBook Pro models as soon as early March, but if you can, this is one generation you should skip because there's something much better in the works. We're waiting on 14-inch and 16-inch MacBook Pro models with M5 Pro and M5 Max chips, with few changes other than the processor upgrade. There won't be any tweaks to the design or the display, but later this...
maxresdefault

Apple Shows Off a Key Reason to Upgrade to the iPhone 17

Saturday February 7, 2026 9:26 am PST by
Apple today shared an ad that shows how the upgraded Center Stage front camera on the latest iPhones improves the process of taking a group selfie. "Watch how the new front facing camera on iPhone 17 Pro takes group selfies that automatically expand and rotate as more people come into frame," says Apple. While the ad is focused on the iPhone 17 Pro and iPhone 17 Pro Max, the regular iPhone...
iOS 26

Apple Releases iOS 26.3 and iPadOS 26.3

Wednesday February 11, 2026 10:07 am PST by
Apple today released iOS 26.3 and iPadOS 26.3, the latest updates to the iOS 26 and iPadOS 26 operating systems that came out in September. The new software comes almost two months after Apple released iOS 26.2 and iPadOS 26.2. The new software can be downloaded on eligible iPhones and iPads over-the-air by going to Settings > General > Software Update. According to Apple's release notes, ...
apple wallet drivers license feature iPhone 15 pro

Apple Says These 7 U.S. States Plan to Offer iPhone Driver's Licenses

Monday February 9, 2026 6:24 am PST by
In select U.S. states, residents can add their driver's license or state ID to the Apple Wallet app on the iPhone and Apple Watch, and then use it to display proof of identity or age at select airports and businesses, and in select apps. The feature is currently available in 13 U.S. states and Puerto Rico, and it is expected to launch in at least seven more in the future. To set up the...
Apple Logo Zoomed

Apple Expected to Launch These 10+ Products Over the Coming Months

Tuesday February 10, 2026 6:33 am PST by
It has been a slow start to 2026 for Apple product launches, with only a new AirTag and a special Apple Watch band released so far. We are still waiting for MacBook Pro models with M5 Pro and M5 Max chips, the iPhone 17e, a lower-cost MacBook with an iPhone chip, long-rumored updates to the Apple TV and HomePod mini, and much more. Apple is expected to release/update the following products...

Top Rated Comments

ErikGrim Avatar
107 months ago
This is good for everyone. Apple sharing this research instead of keeping it proprietary shows they are more interested in getting to a sustainable future faster than retaining whatever competitive business advantage this would give them.
Score: 8 Votes (Like | Disagree)
107 months ago
Why are they making these? Who has ever asked for self driving cars?

We wanted FLYING cars, I think they got this mixed up somewhere.
Score: 7 Votes (Like | Disagree)
107 months ago
check your stats: sad but not millions—fewer than 40,000 deaths per year, “only” 3.6 million 1899-2013, according to National Traffic Safety Transportation Bd.
FYI: US is not the only country on Earth.
http://asirt.org/initiatives/informing-road-users/road-safety-facts/road-crash-statistics

* Nearly 1.3 million people die in road crashes each year, on average 3,287 deaths a day.
* An additional 20-50 million are injured or disabled.
Score: 5 Votes (Like | Disagree)
107 months ago

We wanted FLYING cars, I think they got this mixed up somewhere.
And I wouldn't say no to a time machine, so I can bring back an almanac, get rich and finally be able to afford the new iMac pro
Score: 5 Votes (Like | Disagree)
BvizioN Avatar
107 months ago
Why are they making these? Who has ever asked for self driving cars?

We wanted FLYING cars, I think they got this mixed up somewhere.
One step at a time.
And who asked for self driving cars? Since humans are quite good at causing terrible accidents on the road that costs the life of millions each year, self driving car seems the logical solution. Who wouldn't want to minimise the road accidents?
Score: 4 Votes (Like | Disagree)
BvizioN Avatar
107 months ago
check your stats: sad but not millions—fewer than 40,000 deaths per year, “only” 3.6 million 1899-2013, according to National Traffic Safety Transportation Bd.

that said—I am not yet crazy about self-driving cars either. Daughter and son-in-law were backseat passengers in vehicle with self-driving engaged that “failed to see” highway exit barrier and would have crashed but for host’s screaming shotgun-riding wife.
You most be one of them that thinks US is the entire world. Here ('http://asirt.org/initiatives/informing-road-users/road-safety-facts/road-crash-statistics')
And I was talking about how it effects the millions of others life, the injured.
And of course, a single or maybe few accidents on a beta testing self driving cars of the future is a clear indication of capabilities if this technology. Nothing compare with the human madness on the road.
[doublepost=1511358366][/doublepost]

Careful what you ask for..... quite a few plan crashes were attributed to automation . Sadly human can adapt and react to situations, when a computer encounters an edge case the consequences can be tragic be it a plane or car.
It is a beta testing technology that can be improved beyond what we even think it is possible today.
And thank you, but I don't trust humans on the road. I have seen quite enough. Can't wait to see the day driving on the road becomes illegal (if in my lifetime)
Score: 4 Votes (Like | Disagree)