Apple Executives Discuss iPhone 12 and Apple's Approach to Camera Design

iPhone Product Line Manager Francesca Sweet and Apple Camera Software Engineering Vice President Jon McCormack have provided a new interview to PetaPixel, offering insight into Apple's approach to camera design and development. Crucially, the executives explained that Apple sees camera technology as a holistic union of hardware and software.

iphone12protriplelenscamera

The interview reveals that Apple sees its main goal for smartphone photography as allowing users to "stay in the moment, take a great photo, and get back to what they're doing," without being distracted by the technology behind it.

McCormack explained that while professional photographers go through a process to fine-tune and edit their photos, Apple is attempting to refine that process down to the single action of capturing a frame.

"We replicate as much as we can to what the photographer will do in post," McCormack said. "There are two sides to taking a photo: the exposure, and how you develop it afterwards. We use a lot of computational photography in exposure, but more and more in post and doing that automatically for you. The goal of this is to make photographs that look more true to life, to replicate what it was like to actually be there."

He went on to describe how Apple uses machine learning to break down scenes into natural parts for computational image processing.

"The background, foreground, eyes, lips, hair, skin, clothing, skies. We process all these independently like you would in Lightroom with a bunch of local adjustments," McCormack continued. "We adjust everything from exposure, contrast, and saturation, and combine them all together... We understand what food looks like, and we can optimize the color and saturation accordingly to much more faithfully.

Skies are notoriously hard to really get right, and Smart HDR 3 allows us to segment out the sky and treat it completely independently and then blend it back in to more faithfully recreate what it was like to actually be there."

McCormack explained why Apple chose to include Dolby Vision HDR video capability in the iPhone 12 lineup.

"Apple wants to untangle the tangled industry that is HDR, and how they do that is leading with really great content creation tools. It goes from producing HDR video that was niche and complicated because it needed giant expensive cameras and a video suite to do, to now my 15-year-old daughter can create full Dolby Vision HDR video. So, there will be a lot more Dolby Vision content around. It's in the interest of the industry to now go and create more support."

The executives also discussed the camera hardware improvements of the ‌iPhone 12‌ and ‌iPhone 12‌ Pro, commenting that "the new wide camera, improved image fusion algorithms, make for lower noise and better detail." The specific camera advancements of the iPhone 12 Pro Max were also an area of interest:

"With the Pro Max we can extend that even further because the bigger sensor allows us to capture more light in less time, which makes for better motion freezing at night."

When asked why Apple has only chosen to increase the sensor size now with the ‌iPhone 12 Pro Max‌, McCormack revealed Apple's perspective:

"It's not as meaningful to us anymore to talk about one particular speed and feed of an image, or camera system," he said. "As we create a camera system we think about all those things, and then we think about everything we can do on the software side... You could of course go for a bigger sensor, which has form factor issues, or you can look at it from an entire system to ask if there are other ways to accomplish that. We think about what the goal is, and the goal is not to have a bigger sensor that we can brag about. The goal is to ask how we can take more beautiful photos in more conditions that people are in. It was this thinking that brought about deep fusion, night mode, and temporal image signal processing."

Read the full interview with Sweet and McCormack at PetaPixel.

Related Roundup: iPhone 12
Related Forum: iPhone

Top Rated Comments

DocMultimedia Avatar
27 months ago
Miserable answer for why only the Pro Max got the best camera. I just can't live with the size of the Max, but want the best camera possible. I personally think the Pro line should all have the "Pro" features.
Score: 17 Votes (Like | Disagree)
citysnaps Avatar
27 months ago
I'm super pleased with my 12 Pro. The Pro Max was a non-starter for me not being able to put it in my shirt pocket. As I've been shooting exclusively with a phone for the past five years, that was critical. And not being to being able to navigate the screen easily with one hand sealed it as a deal killer..

The camera on the Pro is superb. Here's a recent photo:



Attachment Image
Score: 14 Votes (Like | Disagree)
AngerDanger Avatar
27 months ago

But did the camera array really have to look like a wonky fidget spinner?
I think it's more like a trypophobe's nightmare…

[SPOILER][/SPOILER]

Attachment Image
Score: 11 Votes (Like | Disagree)
now i see it Avatar
27 months ago
Every spokesman from the company is a salesman. What do people expect them to say? "Yeah the camera is a small upgrade from last year."
Score: 6 Votes (Like | Disagree)
otternonsense Avatar
27 months ago

Miserable answer for why only the Pro Max got the best camera. I just can't live with the size of the Max, but want the best camera possible. I personally think the Pro line should all have the "Pro" features.
Just like the 11 Pro did. It's foolish and greedy IMHO that they'd backtrack on the two best things they did for the 11 Pro: camera parity and amazing battery size/lifespan.
Score: 6 Votes (Like | Disagree)
Caliber26 Avatar
27 months ago

Miserable answer for why only the Pro Max got the best camera. I just can't live with the size of the Max, but want the best camera possible. I personally think the Pro line should all have the "Pro" features.
This review ('https://youtu.be/qrzCLgDplTw') will make you feel better about going with the smaller Pro. Much like the reviewer, I was hoping that the new sensor would be a noticeable upgrade over the sensor in the smaller Pro but that doesn’t seem to be the case. I still pre-ordered the Max just because of the display size but I’m feeling a little underwhelmed by the camera review.
Score: 5 Votes (Like | Disagree)

Related Stories

osbscura 3

Obscura 3 Camera App Gains Overhauled Interface and New Capture Modes

Friday February 18, 2022 2:16 am PST by
Alternative iPhone camera app Obscura 3 has launched with several new camera features and an overhauled design that aims to make its various photography tools easier to access. In the newly designed interface, the control wheel of the previous version has been replaced by an entirely gesture-based control system with haptic feedback, which the developer says improves single-thumb control and ...
iPhone 14 Mock pill and hole

iPhone 14 Pro Design Reportedly Finalized As Suppliers Begin Trial Production

Monday February 21, 2022 3:41 am PST by
Apple's largest supplier, Foxconn, has begun trial production of the iPhone 14 Pro, suggesting that Apple has finalized its design as it moves into the early stages of device manufacturing, according to a report from the Taiwan Economic Times. According to the report, Foxconn will manufacture the higher-end models of the iPhone 14, while Luxshare, another Apple supplier, will take on the...
iphone 13 iphone 13 pro cameras

Leaks Reveal Major iPhone 13 Camera Upgrades

Wednesday September 8, 2021 2:19 am PDT by
The upcoming iPhone 13 models will feature a large number of significant rear camera hardware upgrades, recent reports have revealed. All of the iPhone 13 models, including the 5.4-inch iPhone 13 mini, 6.1-inch iPhone 13, 6.1-inch iPhone 13 Pro, and 6.7-inch iPhone 13 Pro Max, are expected to offer sensor-shift stabilization on their Wide cameras to reduce camera shake, bringing over the...
5

Camera Comparison: Samsung's Galaxy S22 Ultra vs. Apple's iPhone 13 Pro Max

Thursday March 3, 2022 11:47 am PST by
Samsung in February introduced its latest high-end flagship smartphone, the Galaxy S22 Ultra. We picked up one of the new Samsung devices, and thought we'd compare it to Apple's top-of-the-line smartphone, the iPhone 13 Pro Max, to see how the two premium phones compare to one another when it comes to camera quality. Subscribe to the MacRumors YouTube channel for more videos. The Galaxy S22...
iPhone 14 Hole Punch Feature

iPhone 15 Pro Rumored to Feature Under-Screen Face ID System From Samsung

Tuesday March 22, 2022 7:38 pm PDT by
Samsung Display is developing new under-panel camera technology that Apple plans to use to hide Face ID under the display on next year's tentatively named "iPhone 15 Pro" models, according to sources cited by Korean website The Elec. While rumors suggest that this year's "iPhone 14 Pro" models will feature both a "hole-punch" and a pill-shaped cutout for the front camera and Face ID...
iPhone 14 Mock Pill Blue Feature

iPhone 14 Pro Design Details Starting to Emerge

Wednesday January 12, 2022 2:10 am PST by
Key design elements of Apple's "iPhone 14 Pro" are beginning to emerge ahead of the device's expected unveiling in September. The iPhone 14 Pro and iPhone 14 Pro Max, which are expected to come in the same 6.1-inch and 6.7-inch display sizes as the iPhone 13 Pro and iPhone 13 Pro Max, are expected to feature a refreshed design. Apple usually redesigns its flagship iPhone models every two to...
iOS 15

Apple Studio Display Runs Full Version of iOS 15.4

Friday March 18, 2022 5:40 am PDT by
The Apple Studio Display runs a full version of iOS 15.4, Daring Fireball's John Gruber has highlighted. In System Information, under "Graphics/Displays," the Studio Display's software can be seen, showing that it runs "Version 15.4 (Build 19E241)." This is the exact same build number as iOS 15.4 and iPadOS 15.4, indicating that the Studio Display runs the full version of iOS. The Studio...
iPhone 13 Pro Light Blue Side Feature

You Could See Your Doctor Using an iPhone 13 Soon: Here's Why

Monday October 4, 2021 2:12 am PDT by
An iPhone 13 feature "will innovate patient eye care and telemedicine," according to a San Diego-based doctor who has found an unexpected use for one of the device's new abilities. Detailed in a post on LinkedIn, opthalmologist and digital health specialist Dr. Tommy Korn explained that he has been using the iPhone 13 Pro Max to take high-quality macro images of patients' eyes. The iPhone ...

Popular Stories

maxresdefault

Can't Get an iPhone 14 Pro? Here's Why You Should Wait for the iPhone 15 Ultra

Monday December 5, 2022 11:44 am PST by
Due to production issues at Apple supplier factories in China, the iPhone 14 Pro and iPhone 14 Pro Max are backordered and basically out of stock at every store. If you were planning to gift or receive an iPhone 14 Pro model for the holidays and didn't already get one, you're basically out of luck because they're gone until late December. Subscribe to the MacRumors YouTube channel for more ...
General iOS 16 Feature Yellow

iOS 16.2 for iPhone Launching This Month With These 8 New Features

Thursday December 1, 2022 8:44 am PST by
Apple plans to publicly release iOS 16.2 for the iPhone in mid-December, according to Bloomberg's Mark Gurman. The update remains in beta testing for now, with at least eight new features and changes already uncovered so far. iOS 16.2 introduces a number of new features, including Apple's new whiteboard app Freeform, two new Lock Screen widgets for Sleep and Medications, the ability to hide...
Apple car wheel icon feature yellow

Apple to Charge Under $100,000 for Apple Car, Launch Planned for 2026

Tuesday December 6, 2022 2:31 pm PST by
Apple is aiming to launch an Apple-branded consumer-oriented vehicle by 2026, and its goal is to hit a price point under $100,000 to make the car appeal to a wider range of customers, reports Bloomberg. Apple initially planned to design a car that might look similar to Canoo's Lifestyle Vehicle, where passengers could face one another in a limousine-style car with no steering wheel or...
iPhone Measure Height

Newer iPhones Allow You to Measure Someone's Height Instantly — Here's How

Saturday December 3, 2022 10:23 am PST by
iPhone 12 Pro and Pro Max, iPhone 13 Pro and Pro Max, and iPhone 14 Pro and Pro Max models feature a LiDAR Scanner next to the rear camera that can be used to measure a person's height instantly in Apple's preinstalled Measure app. To measure a person's height, simply open the Measure app, point your iPhone at the person you want to measure, and make sure they are visible on the screen from...
introducing apple music sing

Apple Music Adding a Karaoke Experience With Apple Music Sing

Tuesday December 6, 2022 7:09 am PST by
Apple today announced Apple Music Sing, a new feature in Apple Music that lets users sing their favorite songs with adjustable vocals and more. Apple Music Sing will utilize Apple Music's real-time lyrics to allow users to sing to their favorite songs using adjustable vocals, background vocals, and duet view to allow more than one singer.Apple Music Sing includes: Adjustable vocals: Users...
14 vs 16 inch mbp m2 pro and max feature 1

Major RAM Upgrade Coming to Next-Generation MacBook Pro

Friday December 2, 2022 2:03 am PST by
The next-generation MacBook Pro models could feature faster RAM, according to a recent report from a reliable source. MacRumors Forums member "Amethyst," who accurately revealed details about the Mac Studio and Studio Display before those products were announced, recently provided information about Apple's upcoming 14- and 16-inch MacBook Pro models. The new machines are expected to feature...
nothing phone 2

Nothing Plans to Launch Smartphone in US to Take on Apple's iPhone

Monday December 5, 2022 12:38 am PST by
UK-based tech company Nothing plans to launch a smartphone in the US to directly compete with Apple's iPhone, according to a new report out today. In an interview with CNBC, Nothing CEO Carl Pei said the startup is in "early conversations" with American cellular carriers about launching a new phone in the US, but he stopped short of naming any of the carriers or the phone model. Nothing...
apple ar headset concept 1

Kuo: Apple Headset Shipments Potentially Delayed Until Second Half of 2023

Sunday December 4, 2022 7:38 am PST by
Mass shipments of Apple's long-rumored AR/VR headset may be delayed until the second half of 2023 due to unspecified "software-related issues," according to the latest information shared today by tech analyst Ming-Chi Kuo. Apple headset render by Ian Zelbo Kuo said mass shipments of components for the headset are still likely to begin in the first half of 2023, but he believes that mass...
iOS 16

When Will iOS 16.2 Launch?

Friday December 2, 2022 2:13 pm PST by
Apple in late October began testing iOS 16.2 and iPadOS 16.2 updates, providing betas to both developers and public beta testers. As of now, we've had four total betas, with the fourth beta having been released earlier this week. iOS 16.2 and iPadOS 16.2 are expected before the end of the year, and we thought we'd try to narrow down the launch timeline. With only four betas released since...