Apple's AI Team Working on LiDAR, Smaller Neural Networks, Image Processing and More

At an exclusive invitation-only lunch at an AI conference in Barcelona, Spain that took place on December 6, Apple head of machine learning Russ Salakhutdinov and other Apple employees talked about their work on artificial intelligence.

Quartz has obtained some of the slides that Salakhutdinov used during the presentation, giving us a glimpse at the advancements Apple is making in AI and machine learning.

Based on one of the slides, topics at the lunch were wide-ranging, including health and vital signs, volumetric detection of LiDAR, prediction with structured outputs, image processing and colorization, intelligent assistant and language modeling, and activity recognition.

appleairesearchslide
One of the slides, related to Apple's LiDAR work, featured a picture of two cars, but Apple engineers did not mention cars or any automotive research, such as self-driving vehicles. Another slide focused on Apple's image recognition algorithms, which are able to process 3,000 images per second, twice as fast as Google's capabilities. Apple's work on smaller neural networks that can run directly on devices was also covered.

Another slide focused on Apple's ability to build neural networks that are 4.5 times smaller than the originals with no loss in accuracy, and twice the speed. The technique, not unknown in AI research, uses a larger, more robust neural network to teach another network the decisions it would make in a variety of situations. The "student" network then has a streamlined version of the "teacher" network's knowledge. In essence, it predicts the larger network's predictions about a given photo or audio sample.

The discussion also covered some of Apple's research focus areas:

- Deep generative models
- Model compression
- Holistic scene understanding
- Model reliability
- Deep reinforcement learning
- Unsupervised learning, transfer learning, one-shot learning
- Reasoning, attention & memory
- Efficient training on distributed computing

Going forward, Apple plans to allow its AI and machine learning researchers to start publishing papers, marking its willingness to contribute to the research community. Apple has always been notoriously secretive, but allowing researchers to publish could attract top talent that would not otherwise want to join the company.

A full rundown of the slides from Apple's presentation can be seen over at Quartz.

Popular Stories

iOS 18 CarPlay Feature

iOS 18 Adds These 5 New Features to CarPlay

Thursday June 13, 2024 7:44 am PDT by
Apple did not mention CarPlay during its WWDC keynote this week, but iOS 18 includes a handful of new features for the in-car software. Overall, there is not a whole lot new for CarPlay on iOS 18, with changes seemingly limited to the Messages and Settings apps so far. Below, we recap everything new for CarPlay on iOS 18. New for CarPlay on iOS 18 1. Contact Photos in Messages App...
ios 18 button bulge

iOS 18 Adds Pop-Out Bezel Animation When Pressing iPhone Buttons

Tuesday June 11, 2024 10:40 am PDT by
iOS 18 includes a small but interesting change for the buttons on the iPhone, adding more of a visual element when changing volume, activating the Action button, or locking the screen. When you press an iPhone button in iOS 18, the display bezel bulges outward slightly. This feature is available for the volume buttons, Action button and the power button, and it will also likely be used for...
maxresdefault

First Look at Messages via Satellite in iOS 18

Thursday June 13, 2024 11:29 am PDT by
Apple has been gradually expanding its suite of satellite connectivity features for iPhone, and iOS 18 brings a significant new one in the form of Messages via satellite. The feature allows users to send and receive iMessages and SMS texts, including emoji and Tapbacks, while out of range of cellular and Wi-Fi networks. CNET met up with Apple's senior director of platform product marketing,...
iOS 18 Wallet Feature

Here's What's New in Apple Wallet on iOS 18 for Event Tickets and More

Friday June 14, 2024 7:32 am PDT by
iOS 18 includes a handful of enhancements to the Wallet app on the iPhone, with new features for Apple Pay, Apple Cash, event tickets, and more. Below, we outline everything new for the Wallet app on iOS 18, based on information from Apple's press release and a WWDC 2024 coding session. Redesigned Event Tickets Event tickets have an all-new design in the Wallet app on iOS 18, complete...

Top Rated Comments

69Mustang Avatar
98 months ago
Going forward, Apple plans to allow its AI and machine learning researchers to start publishing papers, marking its willingness to contribute to the research community.
This is probably one of the more significant things I got from this post. Good on Apple and about time.
Score: 9 Votes (Like | Disagree)
shelt Avatar
98 months ago
How about assigning one or two of your bazillion employees to a forward thinking new project -- a powerful i7-based desktop computer with modern parts and the ability to upgrade? It should take about two weeks...
Score: 6 Votes (Like | Disagree)
Roller Avatar
98 months ago
First output from the AI neural network: Apple's laptops are too thin and need larger batteries. :)
Score: 4 Votes (Like | Disagree)
oldwatery Avatar
98 months ago
How about getting a few of those people to develop a new COMPUTER?????????
Score: 4 Votes (Like | Disagree)
Since1987 Avatar
98 months ago
I used a search tool, but i can't find the words "SkyNet" or "Terminator" in their presentation.
Score: 3 Votes (Like | Disagree)
SoN1NjA Avatar
98 months ago
But... But... But... All of the Apple haters told me Apple lost the AI race and they've given up
Score: 3 Votes (Like | Disagree)