Apple Shares Research into Self-Driving Car Software That Improves Obstacle Detection

Apple computer scientists working on autonomous vehicle technology have posted a research paper online describing how self-driving cars can spot cyclists and pedestrians using fewer sensors (via Reuters).

The paper by Yin Zhou and Oncel Tuzel was submitted to the moderated scientific pre-print repository arXiv on November 17, in what appears to be Apple's first publicly disclosed research on autonomous vehicle technology.

appleautonomousdrivingtestlexus
The paper is titled "End-to-End Learning for Point Cloud Based 3D Object Detection", and describes how new software developed by Apple scientists improves the ability of LiDAR (Light Detection and Ranging) systems to recognize objects including pedestrians and cyclists from a distance.

Self-driving cars typically use a combination of standard cameras and depth-sensing LiDAR units to receive information about the world around them.

Apple's research team said they were able to get "highly encouraging results" using LiDAR data alone to spot cyclists and pedestrians, and wrote that they were also able to beat other approaches for detecting 3D objects that rely solely on LiDAR tech. The experiments were limited to computer simulations and did not advance to road tests.

Apple famously has a secretive research policy and has kept its work under wraps for many years, but over the last 12 months, the company has shared some of its research advancements with other researchers and the wider public, particularly in the area of machine learning.

In December 2016, Apple said that it would start allowing its AI and machine learning researchers to publish and share their work in papers, with the first paper appearing just a few weeks following the announcement.

Additionally, in July of this year, Apple researchers initiated the "Apple Machine Learning Journal", a blog detailing their work on machine learning, AI, and other related topics.

This new policy of openness could help Apple retain employees who do not want to keep their progress a secret, but the latest research into autonomous vehicle technology also lets regulators see that the company is making progress in this area. Last December, Apple told federal regulators it was excited about the technology and asked them not to restrict testing. In April, the company also filed a self-driving car testing plan with California regulators.

Apple CEO Tim Cook has called autonomy "the mother of all AI projects". During an August 2017 earnings call, Cook re-emphasized Apple's deep interest in the technology, and even hinted Apple's work on autonomy could be used for more than vehicles.

Apple has presumably been working on an autonomous driving system since 2014, when rumors of its efforts to create an electric vehicle first surfaced. Apple has now moved away from creating a full vehicle and is said to be focusing on self-driving technology instead.

Popular Stories

Apple Glass

Apple Smart Glasses: Everything We Know So Far

Wednesday May 21, 2025 8:21 am PDT by
Google recently made waves by showcasing a set of lightweight smart glasses featuring deep Gemini integration and an optional in-lens display. The demo has reignited interest in Apple's own smart glasses project, which has been the subject of rumors for nearly a decade. Here's a recap of where things stand. Current Development Status Apple is actively working on new chips specifically...
Apple Glasses Purple Feature

Apple Smart Glasses Launching in 2026

Thursday May 22, 2025 12:22 pm PDT by
Apple is planning to launch a set of smart glasses by the end of 2026, reports Bloomberg. The glasses will be comparable to the Meta Ray-Bans and the Android XR glasses that Google showed off earlier this week. Apple's smart glasses are expected to include cameras, microphones, and AI capabilities, much like the Meta Ray-Bans. The glasses will be able to take photos, record video, provide...
Apple CarPlay Ultra instrument cluster themes 01

Apple's CarPlay Ultra Is Here – Does Your iPhone Support It?

Thursday May 15, 2025 5:17 am PDT by
Apple's recently announced CarPlay Ultra promises a deeply integrated in-car experience, but not all iPhone users will be able to take advantage of the new feature. According to Apple's press release, CarPlay Ultra requires an iPhone 12 or later running iOS 18.5 or later. This means if you're using an iPhone 11, iPhone XR, or any older model, you'll need to upgrade your device to access...
maxresdefault

OpenAI Buys Jony Ive's AI Startup to 'Completely Reimagine What It Means to Use a Computer'

Wednesday May 21, 2025 10:27 am PDT by
OpenAI is acquiring io, the hardware-based AI startup co-created by Jony Ive, OpenAI announced today. Ive has been working with OpenAI CEO Sam Altman on io for two years, and the duo expects to develop a family of AI devices. In a video shared by OpenAI, Altman and Ive outlined their partnership and what they expect to create as a result of the merger. "I have a growing sense that everything ...
WWDC 2025 Banner

Apple Announces WWDC 2025 Schedule, Including Keynote Time

Tuesday May 20, 2025 8:13 am PDT by
Apple today announced a more detailed schedule for its annual developers conference WWDC, which runs from June 9 through June 13. The schedule confirms that Apple's keynote will begin on Monday, June 9 at 10 a.m. Pacific Time, with a live stream to be available on Apple.com, in the Apple TV app, and on YouTube. During the keynote, Apple is expected to announce iOS 19, iPadOS 19, macOS 16,...
iPod shuffle generations

Kuo: Jony Ive's Futuristic OpenAI Device Like a Neck-Worn iPod Shuffle

Thursday May 22, 2025 8:05 am PDT by
The big news in the technology world this week is that ChatGPT maker OpenAI is working more closely with Apple's former design chief Jony Ive on a futuristic AI device. The company is remaining tight lipped about the device, but Apple supply chain analyst Ming-Chi Kuo has shared some alleged details about its design. In a social media post today, Kuo said the device will be "slightly larger" ...
macOS 16 visionOS Inspired Feature 1

macOS 16: Everything We Know So Far

Tuesday May 20, 2025 7:31 am PDT by
The Worldwide Developers Conference (WWDC), Apple's annual developer and software-oriented event, is less than three weeks away. We haven't heard a great deal about macOS 16 ahead of its announcement this year, so we could be in for some major surprises when June 9 rolls around. Here's what we know so far about the next major update to Apple's Mac operating system. macOS 16 Name? Every year ...

Top Rated Comments

ErikGrim Avatar
98 months ago
This is good for everyone. Apple sharing this research instead of keeping it proprietary shows they are more interested in getting to a sustainable future faster than retaining whatever competitive business advantage this would give them.
Score: 8 Votes (Like | Disagree)
MistrSynistr Avatar
98 months ago
Why are they making these? Who has ever asked for self driving cars?

We wanted FLYING cars, I think they got this mixed up somewhere.
Score: 7 Votes (Like | Disagree)
ISanych Avatar
98 months ago
check your stats: sad but not millions—fewer than 40,000 deaths per year, “only” 3.6 million 1899-2013, according to National Traffic Safety Transportation Bd.
FYI: US is not the only country on Earth.
http://asirt.org/initiatives/informing-road-users/road-safety-facts/road-crash-statistics

* Nearly 1.3 million people die in road crashes each year, on average 3,287 deaths a day.
* An additional 20-50 million are injured or disabled.
Score: 5 Votes (Like | Disagree)
recoil80 Avatar
98 months ago

We wanted FLYING cars, I think they got this mixed up somewhere.
And I wouldn't say no to a time machine, so I can bring back an almanac, get rich and finally be able to afford the new iMac pro
Score: 5 Votes (Like | Disagree)
BvizioN Avatar
98 months ago
Why are they making these? Who has ever asked for self driving cars?

We wanted FLYING cars, I think they got this mixed up somewhere.
One step at a time.
And who asked for self driving cars? Since humans are quite good at causing terrible accidents on the road that costs the life of millions each year, self driving car seems the logical solution. Who wouldn't want to minimise the road accidents?
Score: 4 Votes (Like | Disagree)
BvizioN Avatar
98 months ago
check your stats: sad but not millions—fewer than 40,000 deaths per year, “only” 3.6 million 1899-2013, according to National Traffic Safety Transportation Bd.

that said—I am not yet crazy about self-driving cars either. Daughter and son-in-law were backseat passengers in vehicle with self-driving engaged that “failed to see” highway exit barrier and would have crashed but for host’s screaming shotgun-riding wife.
You most be one of them that thinks US is the entire world. Here ('http://asirt.org/initiatives/informing-road-users/road-safety-facts/road-crash-statistics')
And I was talking about how it effects the millions of others life, the injured.
And of course, a single or maybe few accidents on a beta testing self driving cars of the future is a clear indication of capabilities if this technology. Nothing compare with the human madness on the road.
[doublepost=1511358366][/doublepost]

Careful what you ask for..... quite a few plan crashes were attributed to automation . Sadly human can adapt and react to situations, when a computer encounters an edge case the consequences can be tragic be it a plane or car.
It is a beta testing technology that can be improved beyond what we even think it is possible today.
And thank you, but I don't trust humans on the road. I have seen quite enough. Can't wait to see the day driving on the road becomes illegal (if in my lifetime)
Score: 4 Votes (Like | Disagree)