Microsoft Updates iOS Photo App 'Pix' With Artistic Filters Powered by AI and Deep Neural Networks

by

Microsoft is today updating its smart camera app for iOS devices, Microsoft Pix, with new features that overlay artistic filters on top of user photos. The company said that the Pix team used neural networks to browse massive datasets of classic paintings in order to "learn the essence of what makes a given style of painting recognizable," all in an effort to fuel Pix's new features.

The first feature is called "Pix Styles" and it transforms pictures into styles inspired by popular works of art, or has the ability to add certain effects to a photo like making it look like it's on fire. Microsoft said that Pix Styles differs from traditional "filters" because it adds and alters texture, pattern, and tones to the picture to turn it into something completely different, instead of simply altering the image's colors.


Pix Styles will still optimize the faces of the subjects in a photo to keep people recognizable, which was one of the flagship features of the app when it launched last July. Microsoft called the app "people-centric" when it debuted, since Pix could focus in on faces in a picture to adjust the focus, color, and exposure to ensure each subject looked their best.

One of the Pix team members, Josh Weisberg, said that Microsoft Pix is still a high-quality app with a focus on automatically providing users with the best shots possible, but the new features were added to generate fun moments for users that can be shared on social media.

“These are meant to be fun features,” said Josh Weisberg, a principal program manager in the Computational Photography Group within Microsoft’s research organization in Redmond, Washington. “In the past, a lot of our efforts were focused on using AI and deep learning to capture better moments and better image quality. This is more about fun. I want to do something cool and artistic with my photos.”

Microsoft calls the second feature "Pix Paintings" and it creates a time-lapse animation of the picture being painted in whichever artistic style the user chooses. The Pix team said that the app's artificial intelligence and deep neural networks fuel both the photo transformation in Pix Styles and animated redrawing in Pix Paintings.


Pix Styles specifically will work directly on the iPhone with no cloud requirements needed to run the feature. Microsoft said that this is "part of a broader shift" to push AI away from the cloud and to user devices at the "edge of the network." The user benefits with the update since it lets them play around with Pix Styles "without using your data plan," saving money and lowering load times in the process.

Microsoft Pix is available to download on the iOS App Store for free [Direct Link].

Top Rated Comments

(View all)
Avatar
41 months ago
Seems like a neat application, but why would I would want to hand access to my private photos to a company with a history of filching its customers like Microsoft?

https://www.theguardian.com/world/2013/jul/11/microsoft-nsa-collaboration-user-data
Score: 1 Votes (Like | Disagree)

Top Stories

Apple Announces New 27-Inch iMac With 10th-Gen Processors, Up to 128GB RAM, 1080p Webcam, True Tone, and More

Tuesday August 4, 2020 8:07 am PDT by
Apple today announced a new 27-inch iMac with faster 10th-generation Intel Core processor options, next-generation AMD graphics, up to 128GB of RAM, a higher-resolution 1080p front-facing FaceTime camera, a True Tone display with a nano-texture glass option, a T2 chip, higher fidelity speakers, studio-quality microphones, and more. A breakdown of the new 27-inch iMac's features and specs:10th...

Apple May Launch This Year's 'iPhone 12' Lineup in Two Stages, With 6.1-inch Models Debuting First

Monday August 3, 2020 3:14 am PDT by
Apple last week confirmed that its "‌iPhone‌ 12" launch will be delayed this year due to the ongoing global health crisis and restrictions on travel. Apple last year started selling iPhones in late September, but this year, Apple projects supply will be "available a few weeks later," suggesting a release sometime in October. We're expecting a total of four OLED iPhones in 5.4, 6.1, and...

Apple-Acquired Dark Sky Officially Shuts Down Android App

Saturday August 1, 2020 3:43 pm PDT by
Apple in March purchased weather app Dark Sky, and at that time, Dark Sky's developers said that the app's Android version would be discontinued on July 1, 2020. However, instead of shuttering the app on that date, the app's developers announced that the discontinuation would be delayed for another month. Now that it's August, Android users are no longer able to access the app, and...

Everything New in iOS 14 Beta 4: Apple TV Widget, Search Improvements, Exposure Notification API and More

Tuesday August 4, 2020 11:14 am PDT by
Apple today released the fourth developer betas of iOS and iPadOS 14 for testing purposes, tweaking and refining some of the features and design changes included in the update. Changes get smaller and less notable as the beta testing period goes on, but there are still some noteworthy new features in the fourth beta, which we've highlighted below. - Apple TV widget - There's a new Apple TV...

Apple Explains Why You Might See 'Not Charging' When a Mac is Plugged In

Monday August 3, 2020 1:42 pm PDT by
If you have a Mac and have seen a "Not Charging" warning when plugging it in to power, Apple last week released a support document that explains why. Macs running macOS 10.15.5 or later have a Battery Health Management feature to preserve the life of the battery, and occasionally, the Battery Health Management option will cause the Mac to pause its charging for calibration purposes.Depending ...

Unreleased iPod Touch with Mac Pro Glossy Black Finish Shared Online

Sunday August 2, 2020 11:32 am PDT by
Twitter user @DongleBookPro has today posted images of what seems to be a first-generation iPod Touch prototype with a 2013 Mac Pro-style glossy black finish. The Twitter user claims that the iPod Touch prototype pictured has "the same coating as the 2013 Mac Pro." Had the finish been selected for the final product, it also would have been similar to the metallic glossy black finish that...

Phil Schiller Moving on to Become 'Apple Fellow,' Greg Joswiak Taking Over as Marketing SVP

Tuesday August 4, 2020 10:07 am PDT by
Apple's Phil Schiller is moving on to become an "Apple Fellow," Apple announced today, while Greg Joswiak will take over as Apple's senior vice president of Worldwide Marketing. Schiller will continue to lead the App Store and Apple Events, but will no longer be in charge of marketing. Apple CEO Tim Cook said he is "thrilled" that Joswiak will be leading the marketing team, and that his...

Microsoft to Stop Supporting Office 2016 for Mac in October

Monday August 3, 2020 12:21 pm PDT by
Microsoft's Office 2016 for Mac is set to reach its end of support date on October 13, 2020, and after that date, connecting to Office 365 services using the Office 2016 for Mac software will no longer be supported. Microsoft shared the detail in a support document from July highlighting which versions of Office will be supported for connecting to Office 365 services in the future.Connecting ...

8 Third-Party Home Screen Widgets That You Can Try Out Now on iOS 14

Wednesday August 5, 2020 12:56 pm PDT by
One of the biggest new features of iOS 14 is Home Screen widgets, which provide information from apps at a glance. The widgets can be pinned to the Home Screen in various spots and sizes, allowing for many different layouts. When the iOS 14 beta was first released in June, widgets were limited to Apple's own apps like Calendar and Weather, but several third-party developers have begun to test ...

Apple Shares Requirements for Default Third-Party Browser and Email Apps With Developers

Monday August 3, 2020 4:28 pm PDT by
Apple in iOS 14 plans to allow users to set a third-party app as the default email or browser app on an iPhone or iPad, replacing the current Apple-made default apps Safari and Mail. Apple hasn't provided many details on the new feature to users, but as noted by MacStories' Federico Vittici, Apple has shared documentation with developers who want their apps to have the option to be set as a...