Apple Executives Discuss iPhone 12 and Apple's Approach to Camera Design

iPhone Product Line Manager Francesca Sweet and Apple Camera Software Engineering Vice President Jon McCormack have provided a new interview to PetaPixel, offering insight into Apple's approach to camera design and development. Crucially, the executives explained that Apple sees camera technology as a holistic union of hardware and software.

iphone12protriplelenscamera

The interview reveals that Apple sees its main goal for smartphone photography as allowing users to "stay in the moment, take a great photo, and get back to what they're doing," without being distracted by the technology behind it.

McCormack explained that while professional photographers go through a process to fine-tune and edit their photos, Apple is attempting to refine that process down to the single action of capturing a frame.

"We replicate as much as we can to what the photographer will do in post," McCormack said. "There are two sides to taking a photo: the exposure, and how you develop it afterwards. We use a lot of computational photography in exposure, but more and more in post and doing that automatically for you. The goal of this is to make photographs that look more true to life, to replicate what it was like to actually be there."

He went on to describe how Apple uses machine learning to break down scenes into natural parts for computational image processing.

"The background, foreground, eyes, lips, hair, skin, clothing, skies. We process all these independently like you would in Lightroom with a bunch of local adjustments," McCormack continued. "We adjust everything from exposure, contrast, and saturation, and combine them all together... We understand what food looks like, and we can optimize the color and saturation accordingly to much more faithfully.

Skies are notoriously hard to really get right, and Smart HDR 3 allows us to segment out the sky and treat it completely independently and then blend it back in to more faithfully recreate what it was like to actually be there."

McCormack explained why Apple chose to include Dolby Vision HDR video capability in the iPhone 12 lineup.

"Apple wants to untangle the tangled industry that is HDR, and how they do that is leading with really great content creation tools. It goes from producing HDR video that was niche and complicated because it needed giant expensive cameras and a video suite to do, to now my 15-year-old daughter can create full Dolby Vision HDR video. So, there will be a lot more Dolby Vision content around. It's in the interest of the industry to now go and create more support."

The executives also discussed the camera hardware improvements of the ‌iPhone 12‌ and iPhone 12 Pro, commenting that "the new wide camera, improved image fusion algorithms, make for lower noise and better detail." The specific camera advancements of the iPhone 12 Pro Max were also an area of interest:

"With the Pro Max we can extend that even further because the bigger sensor allows us to capture more light in less time, which makes for better motion freezing at night."

When asked why Apple has only chosen to increase the sensor size now with the ‌iPhone 12 Pro Max‌, McCormack revealed Apple's perspective:

"It's not as meaningful to us anymore to talk about one particular speed and feed of an image, or camera system," he said. "As we create a camera system we think about all those things, and then we think about everything we can do on the software side... You could of course go for a bigger sensor, which has form factor issues, or you can look at it from an entire system to ask if there are other ways to accomplish that. We think about what the goal is, and the goal is not to have a bigger sensor that we can brag about. The goal is to ask how we can take more beautiful photos in more conditions that people are in. It was this thinking that brought about deep fusion, night mode, and temporal image signal processing."

Read the full interview with Sweet and McCormack at PetaPixel.

Related Roundups: iPhone 12, iPhone 12 Pro

Top Rated Comments

DocMultimedia Avatar
16 weeks ago
Miserable answer for why only the Pro Max got the best camera. I just can't live with the size of the Max, but want the best camera possible. I personally think the Pro line should all have the "Pro" features.
Score: 17 Votes (Like | Disagree)
citysnaps Avatar
16 weeks ago
I'm super pleased with my 12 Pro. The Pro Max was a non-starter for me not being able to put it in my shirt pocket. As I've been shooting exclusively with a phone for the past five years, that was critical. And not being to being able to navigate the screen easily with one hand sealed it as a deal killer..

The camera on the Pro is superb. Here's a recent photo:



Attachment Image
Score: 14 Votes (Like | Disagree)
AngerDanger Avatar
16 weeks ago

But did the camera array really have to look like a wonky fidget spinner?
I think it's more like a trypophobe's nightmare…

[SPOILER][/SPOILER]

Attachment Image
Score: 11 Votes (Like | Disagree)
now i see it Avatar
16 weeks ago
Every spokesman from the company is a salesman. What do people expect them to say? "Yeah the camera is a small upgrade from last year."
Score: 6 Votes (Like | Disagree)
otternonsense Avatar
16 weeks ago

Miserable answer for why only the Pro Max got the best camera. I just can't live with the size of the Max, but want the best camera possible. I personally think the Pro line should all have the "Pro" features.
Just like the 11 Pro did. It's foolish and greedy IMHO that they'd backtrack on the two best things they did for the 11 Pro: camera parity and amazing battery size/lifespan.
Score: 6 Votes (Like | Disagree)
Caliber26 Avatar
16 weeks ago

Miserable answer for why only the Pro Max got the best camera. I just can't live with the size of the Max, but want the best camera possible. I personally think the Pro line should all have the "Pro" features.
This review ('https://youtu.be/qrzCLgDplTw') will make you feel better about going with the smaller Pro. Much like the reviewer, I was hoping that the new sensor would be a noticeable upgrade over the sensor in the smaller Pro but that doesn’t seem to be the case. I still pre-ordered the Max just because of the display size but I’m feeling a little underwhelmed by the camera review.
Score: 5 Votes (Like | Disagree)

Top Stories

iphone 6 in hand

Apple Faces Another iPhone Lawsuit Over 'Programmed Obsolescence'

Monday March 1, 2021 6:44 am PST by
Apple faces a new class-action lawsuit that accuses it of deliberately releasing iOS updates that slowly reduce the performance of an iPhone, forcing customers to upgrade their devices. The lawsuit comes from the Portuguese Consumer Protection Agency, Deco Proteste (via Marketeer), which in a statement says that it will proceed with a case against the Cupertino tech giant because it...
PIA23764 RoverNamePlateonMars web

NASA Mars Perseverance Rover Uses Same PowerPC Chipset Found in 1998 G3 iMac

Tuesday March 2, 2021 3:21 am PST by
NASA's Perseverance rover, which recently made history landing on the surface of Mars, is powered by the same processor used in an iMac more than 23 years old. Image Credit: NASA As reported by NewScientist (via Gizmodo), the rover includes the PowerPC 750 processor, the same chip used in the G3 iMac in 1998. The main chipset is the same; however, there are differences between the...
magsafe charging brick feature

Prosser: iPhone 12 MagSafe Battery Pack to Feature Reverse Charging

Monday March 1, 2021 1:18 pm PST by
Apple is working on MagSafe-compatible battery packs that will be compatible with the iPhone 12 models, and leaker Jon Prosser today said on the Genius Bar podcast that one version of the battery pack will feature "reverse charging." According to Prosser, Apple is working on two versions of the battery packs, one that's a standard version and one that's a premium version with reverse...
iphone 12 pro display video

iPhone 13 to Include 1TB Storage Option and LiDAR Across the Board, Says Wedbush Analyst

Monday March 1, 2021 4:00 am PST by
Apple's forthcoming iPhone 13 could include a 1TB storage option for some models and LiDAR Scanners across the entire lineup, according to a report from Wedbush analysts. In a new note to investors, seen by MacRumors, Wedbush analyst Daniel Ives said that initial Asian supply chain checks gave the firm "increased confidence" that Apple's 5G-driven product cycle would extend well into 2022,...
Top Stories 47 Feature copy

Top Stories: MacBook Pro, iMac, and AirPods Rumors, macOS 11.2.2, MagSafe Wallet Revisited

Saturday February 27, 2021 6:00 am PST by
March is right around the corner, and that means our first good opportunity for Apple product launches in 2021 as the company frequently has significant launches in March or April each year. We're hearing rumors about MacBook Pro, iMac, AirPods, and more, although many of these will be coming out at different times over the course of the year. This week also saw a macOS update to address a ...
microsoft edge ios android

Bill Gates Says His Preference for Android Over iPhone is Due to Pre-Installed Software

Friday February 26, 2021 3:35 am PST by
Microsoft co-founder Bill Gates this week participated in his first meeting on Clubhouse, the increasingly popular invite-only conversation app, where he fielded a range of questions as part of an ongoing book tour. Gates was interviewed by journalist Andrew Ross Sorkin, and given that the Clubhouse app is currently only available on iOS, naturally one of the questions that came up was...
iphone 12 120hz thumbnail feature

Kuo: iPhone 13 Lineup to Feature Smaller Notch and Larger Batteries, 120Hz Display for Pro Models, and More

Monday March 1, 2021 7:50 am PST by
iPhone 13 models will all feature a smaller notch, while the two Pro models will be equipped with low-power LTPO display technology for a 120Hz refresh rate, analyst Ming-Chi Kuo said today in a research note obtained by MacRumors. Subscribe to the MacRumors YouTube channel for more videos. Several other sources have previously claimed that some iPhone 13 models will support a 120Hz refresh...
maxresdefault

HomeKit Essentials Worth Checking Out

Saturday February 27, 2021 7:05 am PST by
HomeKit was slow to take off after its 2014 launch, but now that it's been around for seven years, there are hundreds of HomeKit products available, ranging from doorbells and speakers to TVs, lights, and cameras. In our latest YouTube video, we rounded up some of our favorite HomeKit products that we find most useful. Subscribe to the MacRumors YouTube channel for more videos. HomePod...
First Look Big Sur Feature2

Apple Releases macOS Big Sur 11.2.2 to Prevent MacBooks From Being Damaged by Third-Party Non-Compliant Docks

Thursday February 25, 2021 10:07 am PST by
Apple today released macOS Big Sur 11.2.2, the fourth update to the macOS Big Sur operating system that launched in November. macOS Big Sur 11.2.2 comes two weeks after the release of macOS Big Sur 11.2.1, a bug fix update. The new ‌‌‌‌macOS Big Sur‌‌‌ 11.2.2‌ update can be downloaded for free on all eligible Macs using the Software Update section of System Preferences....
Apple Prefer Lightning Over USB C Feature

iPhone Sticking With Lightning Port Over USB-C for 'Foreseeable Future'

Tuesday March 2, 2021 9:32 am PST by
Apple will retain the Lightning connector on the iPhone for the "foreseeable future," with no intention of switching to USB-C, according to reliable analyst Ming-Chi Kuo. In spite of much of the industry moving toward USB-C, Apple will not be using it to replace the Lightning connector on the iPhone 13, or indeed on any iPhone model for the time being. In a note seen by MacRumors yesterday,...