Apple Launches New Blog to Share Details on Machine Learning Research

Apple today debuted a new blog called the "Apple Machine Learning Journal," with a welcome message for readers and an in-depth look at the blog's first topic: "Improving the Realism of Synthetic Images." Apple describes the Machine Learning Journal as a place where users can read posts written by the company's engineers, related to all of the work and progress they've made for technologies in Apple's products.

In the welcome message, Apple encourages those interested in machine learning to contact the company at an email address for its new blog, machine-learning@apple.com.

apple machine learning journal

Welcome to the Apple Machine Learning Journal. Here, you can read posts written by Apple engineers about their work using machine learning technologies to help build innovative products for millions of people around the world. If you’re a machine learning researcher or student, an engineer or developer, we’d love to hear your questions and feedback. Write us at machine-learning@apple.com

In the first post -- described as Vol. 1, Issue 1 -- Apple's engineers delve into machine learning related to neural nets that can create a program to intelligently refine synthetic images in order to make them more realistic. Using synthetic images reduces cost, Apple's engineers pointed out, but "may not be realistic enough" and could result in "poor generalization" on real test images. Because of this, Apple set out to find a way to enhance synthetic images using machine learning.

Most successful examples of neural nets today are trained with supervision. However, to achieve high accuracy, the training sets need to be large, diverse, and accurately annotated, which is costly. An alternative to labelling huge amounts of data is to use synthetic images from a simulator. This is cheap as there is no labeling cost, but the synthetic images may not be realistic enough, resulting in poor generalization on real test images. To help close this performance gap, we’ve developed a method for refining synthetic images to make them look more realistic. We show that training models on these refined images leads to significant improvements in accuracy on various machine learning tasks.

In December 2016, Apple's artificial intelligence team released its first research paper, which had the same focus on advanced image recognition as the first volume of the Apple Machine Learning Journal does today.

The new blog represents Apple's latest step in its progress surrounding AI and machine learning. During an AI conference in Barcelona last year, the company's head of machine learning Russ Salakhutdinov provided a peek behind the scenes of some of Apple's initiatives in these fields, including health and vital signs, volumetric detection of LiDAR, prediction with structured outputs, image processing and colorization, intelligent assistant and language modeling, and activity recognition, all of which could be potential subjects for research papers and blog posts in the future.

Check out the full first post in the Apple Machine Learning Journal right here.

Top Rated Comments

MikhailT Avatar
51 months ago
Except no, it isn’t. It isn’t in this area or other areas.

Apple is sharing their knowledge, and others? They aren’t! Except informercials.
I think he meant that Apple is having a hard time recruiting more AI researchers/scientists that needs to be able to publish their works (they're not the engineers type). In order for Apple to benefit from their minds, they have to start opening up to the public. This isn't your traditional CS work, this is purely scientific research that has a long history of journal-based reviews and public access.

There were many rumors that many AI researchers turned down jobs at Apple simply because they would not be able to publish their works. For these scientists, it is not about the money or the company, it is all about having their work published with their name on it.

In addition, this is one of the areas where knowing other research benefits everyone at the same time.

Google, Facebook, Microsoft and others are in fact publishing their works throughout various mediums (magazines, research papers, etc).

In fact, they all started a partnership to share research among each other, Partnership on AI here: https://www.partnershiponai.org (Apple is founding member along with Microsoft, IBM, Google, Facebook, Amazon, etc.
Score: 11 Votes (Like | Disagree)
AngerDanger Avatar
51 months ago
In the interest of being all scientific and sharing stuff, I read about half of the blogpost and realized some of the implications of its content. The blog specifically uses the example of human eye recognition in its explanation of machine learning and refined synthetic machine-based learning. Hmmmm, I wonder what thing Apple could be using all of this ocular information for? ;)

Assessing Gaze
Part of the blog places emphasis on knowing which direction the sampled eyes are looking. In fact, if the refinement process moves the iris too much, that output is (I think) weighted as less accurate. In the rumors leading up to the iP8 release, many commenters have voiced concern over the device's ability to understand whether or not you actually want it to unlock; it seems Apple might be attempting to address that concern.



Use of Monochrome Samples
Folks have also discussed the potential inability for iris/eye scanning technology to work in the dark, but perhaps they're not considering that your iPhone (or Android) can already see you in the dark. When held to your face during a call in a dark environment, it will shut the screen off. Next to the earpiece, there's a little IR LED that illuminates objects held close to it, and when the phone sees that particular of IR light, it shuts the screen off.



If that light were brighter, it could illuminate the user's entire face. However, because it's only IR light, it wouldn't see the full visible spectrum of light (RGB); it would only see monochrome faces in the dark. It just so happens that the sample images Apple is using are already monochrome.

Anyway, I gotta go buy more tinfoil for my hat!

Attachment Image
Score: 6 Votes (Like | Disagree)
Crzyrio Avatar
51 months ago
Wait?!

Apple launches a blog with employees talking about how they are doing their job???????

The hell froze over, Steve Jobs DEFINITIVELY wouldn’t allow THAT!
It is a must in the AI field
Score: 5 Votes (Like | Disagree)
alwaysbeincontact Avatar
51 months ago
Neat, interesting stuff, nice to Apple getting into blogging now and posting about this future tech.
Score: 4 Votes (Like | Disagree)
dabirdwell Avatar
51 months ago
Interesting! I didn't know about this partnership. I wonder how Elon Musk feels, and why Tesla hasn't joined.
He has OpenAI.

https://www.wired.com/2016/04/openai-elon-musk-sam-altman-plan-to-set-artificial-intelligence-free/
Score: 2 Votes (Like | Disagree)
Zirel Avatar
51 months ago
Wait?!

Apple launches a blog with employees talking about how they are doing their job???????

The hell froze over, Steve Jobs DEFINITIVELY wouldn’t allow THAT!
Score: 1 Votes (Like | Disagree)

Top Stories

iphone12protriplelenscamera

Apple's Orders for Key iPhone 13 Camera Component Expected to Outstrip Entire Android Market

Wednesday June 9, 2021 12:47 am PDT by
Major camera upgrades coming to the iPhone 13 series are putting increased pressure on suppliers to meet Apple's demand for key lens components, according to a new DigiTimes report. Apple has reportedly put Taiwan-based makers of voice coil motor (VCM) components on notice to increase their capacity by 30-40% in order to meet the company's demand, which is expected to outstrip the entire...
live text macos monterey

Several macOS Monterey Features Unavailable on Intel-Based Macs

Wednesday June 9, 2021 8:23 am PDT by
While there are many great new features in macOS Monterey, several of them are not available on Intel-based Macs, according to Apple. On the macOS Monterey features page, fine print indicates that the following features require a Mac with the M1 chip, including any MacBook Air, 13-inch MacBook Pro, Mac mini, and iMac model released since November 2020:Portrait Mode blurred backgrounds in...
m1x mbp tags feature

Apple Lists 'M1X MacBook Pro' in YouTube Tags for WWDC Keynote Video

Wednesday June 9, 2021 7:19 am PDT by
Before WWDC, rumors largely driven by leaker Jon Prosser suggested that Apple would announce redesigned 14-inch and 16-inch MacBook Pros during the conference. Those rumors, however, did not come to fruition. Interestingly, though, Apple lists "m1x MacBook Pro" as a tag for the WWDC keynote uploaded on YouTube. The tag, first spotted by Apple YouTuber Max Balzer on Twitter, is among other...
macos monterey setup assistant

macOS Monterey Allows You to Erase a Mac Without Needing to Reinstall the Operating System

Wednesday June 9, 2021 4:41 pm PDT by
It's been a few days since Apple announced macOS Monterey, and we continue to dig through new features that weren't mentioned during the WWDC keynote, including a much more convenient way of erasing a Mac. Following in the footsteps of the iPhone and iPad, the Mac has gained an "Erase All Content and Settings" option on macOS Monterey. The option allows you to erase all user data and...
apple repair service expansion iphone repair 07072020 big

Apple Agrees to Multimillion-Dollar Settlement After iPhone Repair Technicians Post Customer's Private Photos Online

Monday June 7, 2021 2:44 am PDT by
Apple has paid a 21-year-old millions of dollars in a legal settlement after photos and videos from the customer's iPhone, sent in for repair, were uploaded to Facebook, leading to "severe emotional distress," according to a new report from The Telegraph. The incident occurred in 2016 at a repair facility run by Apple supplier Pegatron in California. The 21-year-old college student sent her...
16 inch macbook pro m2 render

New MacBook Pro Shipments Forecasted to Begin in Third Quarter

Tuesday June 8, 2021 8:28 am PDT by
While leaker Jon Prosser claimed that a new MacBook Pro was coming at WWDC, Apple's keynote did not include any new hardware announcements. Instead, it is looking increasingly likely that redesigned 14-inch and 16-inch MacBook Pro models powered by a faster iteration of the M1 chip will be released in the third or fourth quarter of the year. A paywalled preview of a DigiTimes report today...
maxresdefault

Hands-On With iOS 15: See Apple's New Operating System Update in Action

Tuesday June 8, 2021 3:28 pm PDT by
Apple yesterday unveiled iOS 15, the newest version of the iOS operating system that runs on the iPhone (and the iPad with iPadOS 15). iOS 15 is a significant update that introduces many important new features, and we thought we'd give MacRumors readers a first look at the new software. Subscribe to the MacRumors YouTube channel for more videos. Not everything that was announced yesterday is...
imac macbook pro macos monterey

Newer Macs Can Use Another Mac as an External Display on macOS Monterey

Wednesday June 9, 2021 2:10 pm PDT by
One of the key new features of macOS Monterey is the ability to AirPlay content to a Mac from other Apple devices, such as an iPhone, iPad, or another Mac. According to the macOS Monterey features page, AirPlay to Mac works works both wirelessly or wired using a USB cable, with Apple noting that a wired connection is useful when you want to ensure that there's no latency or don't have access to a ...
Dark Sky App Featured

Dark Sky iOS App, Website, and API Now Scheduled to Remain Available Until End of 2022

Thursday June 10, 2021 7:34 am PDT by
Last year, Apple acquired the weather app Dark Sky, and shortly after its purchase, Apple shut down the app for Android. Despite the revamped iOS 15 Weather app taking heavy inspiration from Dark Sky, the weather's app standalone iOS app, web app, and API will remain available until the end of next year, compared to the end of this year, as previously planned. Dark Sky announced in an update ...
photos app remove from featured

iOS 15 Finally Lets You Block Your Exes From Ruining Your Photo Memories

Wednesday June 9, 2021 12:37 pm PDT by
With iOS 15, Apple is introducing more granular control over the people and places that show up in your Photos Memories, letting you fine tune just who makes random appearances in the Photos app and the Photos widget. In iOS 14, the option on the right was available, but in iOS 15, the person-specific option is new You've already been able to select "Suggest Fewer Memories Like This" when...