Apple Studied Paintings and Shined Light on People to Perfect New Portrait Lighting Feature

iPhone 8 Plus and iPhone X feature advanced cameras with a new Portrait Lighting feature that uses sophisticated algorithms to calculate how your facial features interact with light. That data is used to create lighting effects, such as Natural Light, Studio Light, Contour Light, and Stage Light.


In a new interview with BuzzFeed News reporter John Paczkowski, Apple says it studied the work of portrait photographers such as Richard Avedon, Annie Leibovitz, and Johannes Vermeer, a seventeenth-century Dutch painter, to learn how others have used lighting throughout history.

"We didn't just study portrait photography. We went all the way back to paint," said Apple's marketing chief Phil Schiller.

"If you look at the Dutch Masters and compare them to the paintings that were being done in Asia, stylistically they're different," said Johnnie Manzari, a designer on Apple's Human Interface Team. "So we asked why are they different? And what elements of those styles can we recreate with software?"

Apple said it took what it learned, went into its studio, and spent countless hours shining light on people from different angles.

"We spent a lot of time shining light on people and moving them around — a lot of time," Manzari added. "We had some engineers trying to understand the contours of a face and how we could apply lighting to them through software, and we had other silicon engineers just working to make the process super-fast. We really did a lot of work."

Schiller acknowledged that Apple aims to make a professional camera, ranked the best among smartphones in a recent review, but he added that the company also cares about what it can contribute to photography as a whole.

"We're in a time where the greatest advances in camera technology are happening as much in the software as in the hardware," Schiller said. "And that obviously plays to Apple's strengths over traditional camera companies."

Apple's software advancements allow anyone to simply pick up an iPhone and capture a high-quality photo, eliminating the learning curve that can come with a high-end DSLR camera from the likes of Canon or Nikon.

"It's all seamless; the camera just does what it needs to," said Schiller. "The software knows how to take care of it for you. There are no settings."

Both the iPhone 8 Plus and iPhone X rear cameras been advanced with larger, faster dual-lens sensors, new color filters, and deeper pixels. iPhone X also has optical image stabilization for both the wide-angle and telephoto lenses, the latter of which has a larger ƒ/2.4 aperture that lets more light in.

Read More: How Apple Built An iPhone Camera That Makes Everyone A Professional Photographer

Top Rated Comments

(View all)
Avatar
39 months ago

Gimmicks for the Instagram people.

This obviously isn't a gimmick. It's literally using a 3D model of your face to create advanced lighting effects effortlessly for the user. We're talking about a kind of powerful, futuristic application of computational photography that high end cameras are totally incapable of.
Score: 20 Votes (Like | Disagree)
Avatar
39 months ago

You could get a really nice camera with a lens or two for $1k. Maybe even a proper off camera light.

Can you shove all of that in your pockets?
Score: 18 Votes (Like | Disagree)
Avatar
39 months ago

I mean this is great, but it's kind of sad that their revenue stream demands the massive resources (in both financial and human capital) that Apple possesses be focused on producing a slightly better camera.

Any company that wants to be successful is going to sweat the details. This is what makes Apple great.
Score: 10 Votes (Like | Disagree)
Avatar
39 months ago

That stage light mono photo looks terrible.

In what way? Looks good to me, and I direct video for a living.
Score: 9 Votes (Like | Disagree)
Avatar
39 months ago
They should rename it "Bad Photoshop Filters"
Score: 8 Votes (Like | Disagree)
Avatar
39 months ago

I mean this is great, but it's kind of sad that their revenue stream demands the massive resources (in both financial and human capital) that Apple possesses be focused on producing a slightly better camera.

Thats one of the main reasons many of us upgrade.
Score: 8 Votes (Like | Disagree)

Top Stories

When Will the iPhone 12 Launch? Here's What We Know

Wednesday September 16, 2020 6:12 am PDT by
Yesterday's "Time Flies" Apple event saw the release of the Apple Watch Series 6, Apple Watch SE, iPad 8, and iPad Air 4, but no new iPhone models. Rumors before the event strongly alleged that it would not see the unveiling of new iPhones, with many reports pointing to an October launch. The lack of new iPhone models yesterday seems to confirm that the iPhone 12 lineup will not appear...

iOS 14 Picture in Picture No Longer Working With YouTube's Mobile Website in Safari [Without Premium]

Friday September 18, 2020 12:21 pm PDT by
Apple in iOS 14 added Picture in Picture to the iPhone, a feature designed to let you watch a video in a small screen on your device while you continue to do other things on the phone. When Picture in Picture was working with YouTube The YouTube app doesn't support Picture in Picture, but up until yesterday there was a functional workaround that allowed videos from YouTube.com to be watched...

Hands-On With the New Apple Watch Series 6 and Apple Watch SE

Friday September 18, 2020 1:19 pm PDT by
Today's the official launch date for the Apple Watch Series 6 and the Apple Watch SE, both of which Apple announced on Tuesday. We picked up a couple of the new models and thought we'd give them a quick look for MacRumors readers thinking of ordering a new watch. Apple Watch Series 6 & Apple Watch SE Hands-On! When it comes to design, both the $399 Series 6 and the $279 SE look just like...

Here's How You Can Download iOS 14 and iPadOS 14 Around the World [It's Out]

Wednesday September 16, 2020 2:36 am PDT by
Apple's official public release of iOS 14 and iPadOS 14 dropped on Wednesday, September 16, just a day after the company released the Golden Master to third-party developers. Also set to be made available to the general public for the first time are watchOS 7 and tvOS 14. Getting Started With iOS 14 Video Click image to watch iOS 14 Getting Started While that's left a lot of developers...

Apple Releases iOS 14 and iPadOS 14 With Home Screen Redesign, App Library, Compact UI, Translate App, Scribble Support, App Clips, and More

Wednesday September 16, 2020 12:48 pm PDT by
Apple has released iOS 14 and iPadOS 14, the newest operating system updates designed for the iPhone and iPad. As with all of Apple's software updates, iOS 14 and iPadOS 14 can be downloaded for free. iOS 14 is available on the iPhone 6s and later, while iPadOS 14 is available on the iPad Air 2 and later. The updates are available on all eligible devices over-the-air in the Settings app. To ...

iOS 14.2 Beta Adds New Shazam Music Recognition Feature for Control Center

Thursday September 17, 2020 3:36 pm PDT by
Apple today released the first beta of iOS 14.2 to developers for testing purposes, and the new update introduces a Music Recognition control for the Control Center. The new feature lets you discover music playing around you and it recognizes the music playing with in apps, even when you're wearing AirPods. Songs pop up as notifications, and you can tap to listen in Apple Music....

Apple Updates AirPods 2 and AirPods Pro Firmware to Version 3A283

Monday September 14, 2020 11:24 am PDT by
Apple today released new 3A283 firmware updates for the second-generation AirPods and the AirPods Pro. The second-generation AirPods are being updated from the 2D15 firmware they were previously running, while the AirPods Pros are being updated from the 2D27 firmware they had installed previously. Apple does not provide details on what's included in refreshed firmware so we don't know what's ...

Rumor Report Card: Assessing the Accuracy of Leaks After Apple's Event

Friday September 18, 2020 12:57 pm PDT by
Apple hosted its virtual "Time Flies" event this week, where it introduced four new products, including the Apple Watch Series 6, lower-cost Apple Watch SE, a 10.9-inch iPad Air with an all-screen design, and an updated 10.2-inch iPad with a faster A12 Bionic chip. As expected, there were no new iPhones, which are believed to be coming in October instead. Apple also announced that it will be ...

Epic Games Announces 'Fortnite: Save the World' Will No Longer Be Playable on macOS

Friday September 18, 2020 4:50 am PDT by
Epic Games has announced that "Fortnite: Save the World" will no longer be playable on macOS, after Apple terminated Epic Games' developer account. Fortnite has been in violation of the ‌App Store‌ rules since August 13, when it introduced a direct payment option that skirted Apple's in-app purchase system by allowing payments directly to ‌Epic Games‌. Shortly after Epic blatantly...

Deals: Cellular Carriers Introduce First Offers on Apple Watch Series 6 and SE

Friday September 18, 2020 7:43 am PDT by
With the launch of the Apple Watch Series 6 and Apple Watch SE today, cellular carriers have now introduced special offers for these new wearable devices. Note: MacRumors is an affiliate partner with these vendors. When you click a link and make a purchase, we may receive a small payment, which helps us keep the site running. Starting with AT&T, if you buy one Apple Watch Series 3, Series...