Apple's AI Team Working on LiDAR, Smaller Neural Networks, Image Processing and More

At an exclusive invitation-only lunch at an AI conference in Barcelona, Spain that took place on December 6, Apple head of machine learning Russ Salakhutdinov and other Apple employees talked about their work on artificial intelligence.

Quartz has obtained some of the slides that Salakhutdinov used during the presentation, giving us a glimpse at the advancements Apple is making in AI and machine learning.

Based on one of the slides, topics at the lunch were wide-ranging, including health and vital signs, volumetric detection of LiDAR, prediction with structured outputs, image processing and colorization, intelligent assistant and language modeling, and activity recognition.

appleairesearchslide
One of the slides, related to Apple's LiDAR work, featured a picture of two cars, but Apple engineers did not mention cars or any automotive research, such as self-driving vehicles. Another slide focused on Apple's image recognition algorithms, which are able to process 3,000 images per second, twice as fast as Google's capabilities. Apple's work on smaller neural networks that can run directly on devices was also covered.

Another slide focused on Apple's ability to build neural networks that are 4.5 times smaller than the originals with no loss in accuracy, and twice the speed. The technique, not unknown in AI research, uses a larger, more robust neural network to teach another network the decisions it would make in a variety of situations. The "student" network then has a streamlined version of the "teacher" network's knowledge. In essence, it predicts the larger network's predictions about a given photo or audio sample.

The discussion also covered some of Apple's research focus areas:

- Deep generative models
- Model compression
- Holistic scene understanding
- Model reliability
- Deep reinforcement learning
- Unsupervised learning, transfer learning, one-shot learning
- Reasoning, attention & memory
- Efficient training on distributed computing

Going forward, Apple plans to allow its AI and machine learning researchers to start publishing papers, marking its willingness to contribute to the research community. Apple has always been notoriously secretive, but allowing researchers to publish could attract top talent that would not otherwise want to join the company.

A full rundown of the slides from Apple's presentation can be seen over at Quartz.

Top Rated Comments

69Mustang Avatar
57 months ago
Going forward, Apple plans to allow its AI and machine learning researchers to start publishing papers, marking its willingness to contribute to the research community.
This is probably one of the more significant things I got from this post. Good on Apple and about time.
Score: 9 Votes (Like | Disagree)
shelt Avatar
57 months ago
How about assigning one or two of your bazillion employees to a forward thinking new project -- a powerful i7-based desktop computer with modern parts and the ability to upgrade? It should take about two weeks...
Score: 6 Votes (Like | Disagree)
Roller Avatar
57 months ago
First output from the AI neural network: Apple's laptops are too thin and need larger batteries. :)
Score: 4 Votes (Like | Disagree)
oldwatery Avatar
57 months ago
How about getting a few of those people to develop a new COMPUTER?????????
Score: 4 Votes (Like | Disagree)
Since1987 Avatar
57 months ago
I used a search tool, but i can't find the words "SkyNet" or "Terminator" in their presentation.
Score: 3 Votes (Like | Disagree)
SoN1NjA Avatar
57 months ago
But... But... But... All of the Apple haters told me Apple lost the AI race and they've given up
Score: 3 Votes (Like | Disagree)

Top Stories

flat imac 3d 3 teal

Reliable Leaker Hints Redesigned Colorful iMac to Debut at 'Spring Loaded' Event

Saturday April 17, 2021 4:43 am PDT by
Reliable leaker known as l0vetodream has hinted that Apple may debut its rumored redesigned and colorful iMac at its "Spring Loaded" event on Tuesday, April 20. In a tweet, the leaker posted an image of Apple's logo used for marketing the upcoming event and an image of the retro rainbow Apple logo alongside the colorful lineup of G3 iMacs. Apple leaker Jon Prosser previously reported that...
third gen Apple pencil leaked video

Video of Alleged Third-Generation Apple Pencil Leaks Ahead of Apple Event

Friday April 16, 2021 6:13 am PDT by
A video purporting to be of the third-generation Apple Pencil has today been shared online, showing a glossy finish that mirrors previous leaks. New ✏️ ready to 🚢 #AppleEvent @TommyBo50387266 pic.twitter.com/s4RCDwDi5M— 漢尼斯·拉斯納 🇨🇳 (@ileakeer) April 16, 2021 The brief video from Twitter account @ileakeer, spotted by 9to5Mac, shows an Apple Pencil with a glossy finish much like the...
important battery message iphone 11

Some iPhone 11 Users Seeing Increased Battery Health Percentages After iOS 14.5 Recalibration Process

Friday April 16, 2021 6:32 am PDT by
In the sixth beta of iOS 14.5, Apple introduced a recalibration process for the battery health reporting system on the iPhone 11, iPhone 11 Pro, and iPhone 11 Pro Max to address inaccurate battery health estimates for some users. Apple said this process might take a few weeks to be completed, and now that two weeks have passed since the sixth beta of iOS 14.5 was released, some users are...
apple event particularly innovative article

Gurman: Apple's 'Spring Loaded' Event Won't Feature Anything 'Particularly Innovative'

Thursday April 15, 2021 1:30 am PDT by
Bloomberg's highly-respected Mark Gurman says that he expects nothing "particularly innovative" or "extraordinary" to launch at Apple's "Spring Loaded" event next week, Tuesday, April 20. Gurman made the remarks during an interview for Bloomberg Technology, in which he reaffirmed that Apple will launch a new 11-inch and 12.9-inch iPad Pro, with the higher-end model featuring a brand new...
Top Stories 57 Feature

Top Stories: Apple Event Next Tuesday, Mini-LED iPad Pro, iPhone Rumors

Saturday April 17, 2021 6:00 am PDT by
It feels like we've been waiting forever for new Apple products, but the wait is almost over as Apple has announced a media event for next Tuesday, so make sure to tune into MacRumors for full coverage of everything Apple announces. While that was the big news this week, we also got some new details on Apple's iPhone plans for 2022 and 2023 courtesy of analyst Ming-Chi Kuo, and we also saw...
apple event spring loaded

Apple's 'Spring Loaded' Event Officially Announced for Tuesday, April 20

Tuesday April 13, 2021 9:04 am PDT by
Following an overnight leak by Siri, Apple today officially announced that it will be holding a special "Spring Loaded" event on Tuesday, April 20 at 10:00 a.m. Pacific Time at the Steve Jobs Theater on the Apple Park campus in Cupertino, California. As with all of Apple's 2020 events, the April 2021 event will be a digital-only gathering with no members of the media invited to attend in...
maxresdefault

Hands-On With Anker's MagSafe-Compatible Battery Pack

Thursday April 15, 2021 9:39 am PDT by
Anker, a company known for its range of accessories designed for Apple products, recently came out with one of the first MagSafe-compatible battery packs, so we thought we'd check it out to see how it compares to a standard battery pack. Subscribe to the MacRumors YouTube channel for more videos. Design wise, Anker's power bank looks like a typical battery pack, but it has magnets built in...
iphone 13 pro max cads eap

iPhone 13 Series CAD Leaks Reveal Larger Camera Dimensions

Friday April 16, 2021 1:53 am PDT by
Information and alleged CADs of the upcoming iPhone 13 series, shared in a video from EverythingApplePro, indicates that Apple plans to make this year's iPhone camera module significantly bigger, likely to make way for larger sensors and sensor-shift stabilization. According to the CADs shared in the video, the iPhone 13 mini, Pro, and Pro Max camera module will all be a "perfect square."...
jaguar car homekit

User Adds Car to HomeKit for In-App Controls and Automations, Showing Future Potential

Thursday April 15, 2021 6:17 am PDT by
Blogger Siobhán Ellis has successfully integrated their electric car into their Apple HomeKit setup, adding in-app toggles for door locking, climate control, and more. The setup, which is outlined in detail on the blog Practical HomeKit, allows multiple elements of a Jaguar I-Pace electric vehicle to be monitored, controlled, and automated using the Home app. Using a HomeBridge plugin for ...
siir apple event april 20

Siri Reveals Apple Event Planned for Tuesday, April 20

Tuesday April 13, 2021 12:04 am PDT by
Siri has apparently prematurely revealed that Apple plans to hold an event on Tuesday, April 20, where the company is expected to reveal brand new iPad Pro models and possibly its long-awaited AirTags trackers. Subscribe to the MacRumors YouTube channel for more videos. Upon being asked "When is the next Apple Event," Siri is currently responding with, "The special event is on Tuesday, April...