Apple's AI Team Working on LiDAR, Smaller Neural Networks, Image Processing and More

At an exclusive invitation-only lunch at an AI conference in Barcelona, Spain that took place on December 6, Apple head of machine learning Russ Salakhutdinov and other Apple employees talked about their work on artificial intelligence.

Quartz has obtained some of the slides that Salakhutdinov used during the presentation, giving us a glimpse at the advancements Apple is making in AI and machine learning.

Based on one of the slides, topics at the lunch were wide-ranging, including health and vital signs, volumetric detection of LiDAR, prediction with structured outputs, image processing and colorization, intelligent assistant and language modeling, and activity recognition.

appleairesearchslide
One of the slides, related to Apple's LiDAR work, featured a picture of two cars, but Apple engineers did not mention cars or any automotive research, such as self-driving vehicles. Another slide focused on Apple's image recognition algorithms, which are able to process 3,000 images per second, twice as fast as Google's capabilities. Apple's work on smaller neural networks that can run directly on devices was also covered.

Another slide focused on Apple's ability to build neural networks that are 4.5 times smaller than the originals with no loss in accuracy, and twice the speed. The technique, not unknown in AI research, uses a larger, more robust neural network to teach another network the decisions it would make in a variety of situations. The "student" network then has a streamlined version of the "teacher" network's knowledge. In essence, it predicts the larger network's predictions about a given photo or audio sample.

The discussion also covered some of Apple's research focus areas:

- Deep generative models
- Model compression
- Holistic scene understanding
- Model reliability
- Deep reinforcement learning
- Unsupervised learning, transfer learning, one-shot learning
- Reasoning, attention & memory
- Efficient training on distributed computing

Going forward, Apple plans to allow its AI and machine learning researchers to start publishing papers, marking its willingness to contribute to the research community. Apple has always been notoriously secretive, but allowing researchers to publish could attract top talent that would not otherwise want to join the company.

A full rundown of the slides from Apple's presentation can be seen over at Quartz.

Top Rated Comments

69Mustang Avatar
54 months ago

Going forward, Apple plans to allow its AI and machine learning researchers to start publishing papers, marking its willingness to contribute to the research community.

This is probably one of the more significant things I got from this post. Good on Apple and about time.
Score: 9 Votes (Like | Disagree)
shelt Avatar
54 months ago
How about assigning one or two of your bazillion employees to a forward thinking new project -- a powerful i7-based desktop computer with modern parts and the ability to upgrade? It should take about two weeks...
Score: 6 Votes (Like | Disagree)
Roller Avatar
54 months ago
First output from the AI neural network: Apple's laptops are too thin and need larger batteries. :)
Score: 4 Votes (Like | Disagree)
oldwatery Avatar
54 months ago
How about getting a few of those people to develop a new COMPUTER?????????
Score: 4 Votes (Like | Disagree)
Since1987 Avatar
54 months ago
I used a search tool, but i can't find the words "SkyNet" or "Terminator" in their presentation.
Score: 3 Votes (Like | Disagree)
SoN1NjA Avatar
54 months ago
But... But... But... All of the Apple haters told me Apple lost the AI race and they've given up
Score: 3 Votes (Like | Disagree)

Top Stories

Flat MacBook Air Feature

Bloomberg: Apple Working on 'Thinner and Lighter' High-End MacBook Air With MagSafe, Could Launch in Second Half of 2021

Friday January 22, 2021 3:34 am PST by
Apple is working on a "thinner and lighter" version of the MacBook Air that the company plans to release during the second half of this year at the earliest or in 2022, according to a new report by well-connected Bloomberg journalist Mark Gurman. It will include Apple's MagSafe charging technology and a next-generation version of the company's in-house Mac processors. Apple has discussed...
Top Stories 44 Feature

Top Stories: 'Thinner and Lighter' MacBook Air, Smaller iPhone 13 Notch, iOS 14.4 Incoming

Saturday January 23, 2021 6:00 am PST by
We continued to hear a lot more about Apple's plans for its Mac lineup this week, including word of a high-end redesigned MacBook Air and the return of an SD card slot as part of the upcoming MacBook Pro redesign. It also sounds like Apple has been working on Face ID for Mac, but it won't be appearing in a redesigned iMac this year as originally planned. This week also saw rumors about the...
Apple VR Feature

Bloomberg: Apple's First AR/VR Headset 'Pricey, Niche Precursor' to More Ambitious AR Glasses and Could Launch Next Year

Thursday January 21, 2021 3:27 am PST by
Apple's first virtual reality headset will be a "pricey, niche precursor" to a more ambitious augmented reality product, according to a new report from Bloomberg's Mark Gurman. As a mostly virtual reality device, it will display an all-encompassing 3-D digital environment for gaming, watching video and communicating. AR functionality, the ability to overlay images and information over a view...
iOS 15 icon mock banner

iOS 15 Rumored to Drop Support for iPhone 6s and 2016 iPhone SE

Thursday January 21, 2021 11:58 am PST by
Apple's upcoming iOS 15 operating system, which we expect to see unveiled in June, is rumored to be dropping support for a few of Apple's older iPhones. According to French site iPhoneSoft, iOS 15 will not be able to be installed on the iPhone 6s, the iPhone 6s Plus, or the 2016 iPhone SE, all of which have an A9 chip. The iPhone 6s and 6s Plus were introduced in 2015 and are now more...
2021 mbp sd slot feature2

Bloomberg: Next MacBook Pro to Feature SD Card Reader

Friday January 22, 2021 7:50 am PST by
Last week, reputable analyst Ming-Chi Kuo outlined his expectations for new 14-inch and 16-inch MacBook Pro models later this year, including the return of the MagSafe charging connector, the removal of the Touch Bar, a new flat-edged design, and the return of more ports built into the notebooks for expanded connectivity. A concept of a modern MacBook Pro with an SD card reader Kuo did not...
iPhone 13 Notch Feature

iPhone 13 Rumored to Feature Smaller Notch, Pro Model Cameras to Use Larger Image Sensor

Thursday January 21, 2021 1:38 am PST by
Apple's iPhone 13 series will feature a redesigned Face ID system that will allow for a smaller notch at the top of the screen, according to a new report today. The rumor comes via hit-and-miss Taiwanese industry publication DigiTimes, whose supply chain sources also claim that the ultra wide-angle lens in Apple's next-generation iPhones is due for an upgrade. The next-generation iPhones'...
airpods galaxy buds comparison

Samsung Galaxy Buds Pro vs. Apple AirPods Pro

Friday January 22, 2021 2:34 pm PST by
Samsung in January unveiled new flagship Galaxy S21 smartphones and alongside the new phones, introduced the $200 Galaxy Buds Pro, which are priced at $199 and offer Active Noise Cancellation. Subscribe to the MacRumors YouTube channel for more videos. These new Galaxy Buds Pro are clearly designed to compete with Apple's AirPods Pro, so we thought we'd compare the two sets of earbuds in our...
maxresdefault

Video Demos macOS Catalina Running on iPad Pro via x86 Emulation

Thursday January 21, 2021 11:36 am PST by
A video demonstrating macOS Catalina running on a current 2020 iPad Pro has been shared on YouTube, giving us a look at an interesting hack that has a Mac OS up and working on one of Apple's iPads. There's limited information about how the process of getting macOS Catalina on an iPad Pro works, but it uses x86 emulation and was done through the UTM software that allows virtual machines to...
2019 mac pro side and front

Tim Cook Gifted Donald Trump 'First' 2019 Mac Pro

Wednesday January 20, 2021 5:45 pm PST by
Apple CEO Tim Cook gifted former United States President Donald Trump with the first 2019 Mac Pro that came off of the assembly line in Austin, Texas, according to a financial disclosure report that was released today (via The Verge). "Mac Pro Computer, the first created at the Flex Factory in Austin, Texas," reads the entry, which values the machine at $5,999, the base price for a Mac Pro....
iOS 14

Apple Seeds iOS 14.4 and iPadOS 14.4 Release Candidate to Developers and Public Beta Testers

Thursday January 21, 2021 10:14 am PST by
Apple today seeded the RC version of upcoming iOS 14.4 and iPadOS 14.4 updates to developers for testing purposes, with the new betas coming a week after Apple released the second betas. iOS 14.4 and iPadOS 14.4 can be downloaded through the Apple Developer Center or over the air after the proper profile has been installed on an iPhone or iPad. Paired with the HomePod 14.4 beta that is...