Apple Launches New Blog to Share Details on Machine Learning Research

Apple today debuted a new blog called the "Apple Machine Learning Journal," with a welcome message for readers and an in-depth look at the blog's first topic: "Improving the Realism of Synthetic Images." Apple describes the Machine Learning Journal as a place where users can read posts written by the company's engineers, related to all of the work and progress they've made for technologies in Apple's products.

In the welcome message, Apple encourages those interested in machine learning to contact the company at an email address for its new blog, machine-learning@apple.com.

apple machine learning journal

Welcome to the Apple Machine Learning Journal. Here, you can read posts written by Apple engineers about their work using machine learning technologies to help build innovative products for millions of people around the world. If you’re a machine learning researcher or student, an engineer or developer, we’d love to hear your questions and feedback. Write us at machine-learning@apple.com

In the first post -- described as Vol. 1, Issue 1 -- Apple's engineers delve into machine learning related to neural nets that can create a program to intelligently refine synthetic images in order to make them more realistic. Using synthetic images reduces cost, Apple's engineers pointed out, but "may not be realistic enough" and could result in "poor generalization" on real test images. Because of this, Apple set out to find a way to enhance synthetic images using machine learning.

Most successful examples of neural nets today are trained with supervision. However, to achieve high accuracy, the training sets need to be large, diverse, and accurately annotated, which is costly. An alternative to labelling huge amounts of data is to use synthetic images from a simulator. This is cheap as there is no labeling cost, but the synthetic images may not be realistic enough, resulting in poor generalization on real test images. To help close this performance gap, we’ve developed a method for refining synthetic images to make them look more realistic. We show that training models on these refined images leads to significant improvements in accuracy on various machine learning tasks.

In December 2016, Apple's artificial intelligence team released its first research paper, which had the same focus on advanced image recognition as the first volume of the Apple Machine Learning Journal does today.

The new blog represents Apple's latest step in its progress surrounding AI and machine learning. During an AI conference in Barcelona last year, the company's head of machine learning Russ Salakhutdinov provided a peek behind the scenes of some of Apple's initiatives in these fields, including health and vital signs, volumetric detection of LiDAR, prediction with structured outputs, image processing and colorization, intelligent assistant and language modeling, and activity recognition, all of which could be potential subjects for research papers and blog posts in the future.

Check out the full first post in the Apple Machine Learning Journal right here.

Popular Stories

sonny iphone 16 pro colors

New iPhone 16 and iPhone 16 Pro Colors Revealed Ahead of Apple Event

Friday September 6, 2024 5:01 am PDT by
Apple is "shaking up its color palette" for its iPhone 16 lineup this year, according to well-connected Bloomberg reporter Mark Gurman. Early iPhone 16 Pro dummy models via Sonny Dickson According to Gurman, the iPhone 16 Pro models will come in a Gold Titanium to replace Blue Titanium, while the Black, White, and Natural Titanium options that debuted with the iPhone 15 Pro will remain...
Generic iOS 18 Feature Real Mock

iOS 18 Coming Later This Month With These 8 New Features

Tuesday September 3, 2024 12:07 pm PDT by
iOS 18 has been in beta testing for nearly three months, and the software update will finally be released for all compatible iPhones soon. Apple should reveal iOS 18's exact release date during its September 9 event, with the most likely possibility being Monday, September 16. Below, we have highlighted eight key new features included in iOS 18. Note that Apple Intelligence is not coming...
iPhone 16 Pro Mock Article

How Much Will the iPhone 16 Cost?

Friday September 6, 2024 5:43 am PDT by
Apple's next-generation iPhone 16 series is expected to launch on September 20 and will compete in a quickly evolving smartphone market, and with some notable upgrades rumored, the new models could see price changes compared to previous years. Successive iPhone models always come with new features and hardware upgrades, but Apple typically does not increase the retail prices as a result....
its glowtime event youtube

Report Details Last-Minute Apple Event Rumors About New iPhones, Apple Watches, and AirPods

Friday September 6, 2024 4:40 am PDT by
Bloomberg's Mark Gurman today shared his final expectations for Apple's "It's Glowtime" event, providing some new tidbits and clarifications about the new devices set to be announced on Monday. iPhone 16 Pro Along with larger 6.3- and 6.9-inch display sizes, the iPhone 16 Pro and iPhone 16 Pro Max will have bezels that are "now about a third slimmer" for a "sleeker overall look." The...
iOS 18 CarPlay Feature

iOS 18 Adds These 6 New Features to CarPlay

Tuesday September 3, 2024 12:59 pm PDT by
Apple did not mention CarPlay when it unveiled iOS 18 in June, but the update includes a handful of new features for the in-car iPhone system. iOS 18 includes some changes to the Messages app, Settings app, and Siri on CarPlay. The update should be widely released later in September. Below, we recap CarPlay's key new features on iOS 18. 1. Contact Photos in Messages App iOS 18 adds...
apple watch series 9 display

'Noticeably Thinner' Apple Watch Series 10 to Eventually Get Sleep Apnea Detection

Friday September 6, 2024 4:42 am PDT by
The Apple Watch Series 10 will include a new sleep apnea detection feature, but it may not be available as soon as the new model launches, according to Bloomberg's Mark Gurman. Sleep apnea detection, which builds on the watch's existing sleep tracking, will attempt to determine if a wearer has sleep apnea and then suggest further testing with a medical professional. Gurman had expressed...

Top Rated Comments

MikhailT Avatar
93 months ago
Except no, it isn’t. It isn’t in this area or other areas.

Apple is sharing their knowledge, and others? They aren’t! Except informercials.
I think he meant that Apple is having a hard time recruiting more AI researchers/scientists that needs to be able to publish their works (they're not the engineers type). In order for Apple to benefit from their minds, they have to start opening up to the public. This isn't your traditional CS work, this is purely scientific research that has a long history of journal-based reviews and public access.

There were many rumors that many AI researchers turned down jobs at Apple simply because they would not be able to publish their works. For these scientists, it is not about the money or the company, it is all about having their work published with their name on it.

In addition, this is one of the areas where knowing other research benefits everyone at the same time.

Google, Facebook, Microsoft and others are in fact publishing their works throughout various mediums (magazines, research papers, etc).

In fact, they all started a partnership to share research among each other, Partnership on AI here: https://www.partnershiponai.org (Apple is founding member along with Microsoft, IBM, Google, Facebook, Amazon, etc.
Score: 11 Votes (Like | Disagree)
AngerDanger Avatar
93 months ago
In the interest of being all scientific and sharing stuff, I read about half of the blogpost and realized some of the implications of its content. The blog specifically uses the example of human eye recognition in its explanation of machine learning and refined synthetic machine-based learning. Hmmmm, I wonder what thing Apple could be using all of this ocular information for? ;)

Assessing Gaze
Part of the blog places emphasis on knowing which direction the sampled eyes are looking. In fact, if the refinement process moves the iris too much, that output is (I think) weighted as less accurate. In the rumors leading up to the iP8 release, many commenters have voiced concern over the device's ability to understand whether or not you actually want it to unlock; it seems Apple might be attempting to address that concern.



Use of Monochrome Samples
Folks have also discussed the potential inability for iris/eye scanning technology to work in the dark, but perhaps they're not considering that your iPhone (or Android) can already see you in the dark. When held to your face during a call in a dark environment, it will shut the screen off. Next to the earpiece, there's a little IR LED that illuminates objects held close to it, and when the phone sees that particular of IR light, it shuts the screen off.



If that light were brighter, it could illuminate the user's entire face. However, because it's only IR light, it wouldn't see the full visible spectrum of light (RGB); it would only see monochrome faces in the dark. It just so happens that the sample images Apple is using are already monochrome.

Anyway, I gotta go buy more tinfoil for my hat!

Attachment Image
Score: 6 Votes (Like | Disagree)
Crzyrio Avatar
93 months ago
Wait?!

Apple launches a blog with employees talking about how they are doing their job???????

The hell froze over, Steve Jobs DEFINITIVELY wouldn’t allow THAT!
It is a must in the AI field
Score: 5 Votes (Like | Disagree)
alwaysbeincontact Avatar
93 months ago
Neat, interesting stuff, nice to Apple getting into blogging now and posting about this future tech.
Score: 4 Votes (Like | Disagree)
dabirdwell Avatar
93 months ago
Interesting! I didn't know about this partnership. I wonder how Elon Musk feels, and why Tesla hasn't joined.
He has OpenAI.

https://www.wired.com/2016/04/openai-elon-musk-sam-altman-plan-to-set-artificial-intelligence-free/
Score: 2 Votes (Like | Disagree)
Zirel Avatar
93 months ago
Wait?!

Apple launches a blog with employees talking about how they are doing their job???????

The hell froze over, Steve Jobs DEFINITIVELY wouldn’t allow THAT!
Score: 1 Votes (Like | Disagree)