Apple Executives Discuss iPhone 12 and Apple's Approach to Camera Design

iPhone Product Line Manager Francesca Sweet and Apple Camera Software Engineering Vice President Jon McCormack have provided a new interview to PetaPixel, offering insight into Apple's approach to camera design and development. Crucially, the executives explained that Apple sees camera technology as a holistic union of hardware and software.

iphone12protriplelenscamera

The interview reveals that Apple sees its main goal for smartphone photography as allowing users to "stay in the moment, take a great photo, and get back to what they're doing," without being distracted by the technology behind it.

McCormack explained that while professional photographers go through a process to fine-tune and edit their photos, Apple is attempting to refine that process down to the single action of capturing a frame.

"We replicate as much as we can to what the photographer will do in post," McCormack said. "There are two sides to taking a photo: the exposure, and how you develop it afterwards. We use a lot of computational photography in exposure, but more and more in post and doing that automatically for you. The goal of this is to make photographs that look more true to life, to replicate what it was like to actually be there."

He went on to describe how Apple uses machine learning to break down scenes into natural parts for computational image processing.

"The background, foreground, eyes, lips, hair, skin, clothing, skies. We process all these independently like you would in Lightroom with a bunch of local adjustments," McCormack continued. "We adjust everything from exposure, contrast, and saturation, and combine them all together... We understand what food looks like, and we can optimize the color and saturation accordingly to much more faithfully.

Skies are notoriously hard to really get right, and Smart HDR 3 allows us to segment out the sky and treat it completely independently and then blend it back in to more faithfully recreate what it was like to actually be there."

McCormack explained why Apple chose to include Dolby Vision HDR video capability in the iPhone 12 lineup.

"Apple wants to untangle the tangled industry that is HDR, and how they do that is leading with really great content creation tools. It goes from producing HDR video that was niche and complicated because it needed giant expensive cameras and a video suite to do, to now my 15-year-old daughter can create full Dolby Vision HDR video. So, there will be a lot more Dolby Vision content around. It's in the interest of the industry to now go and create more support."

The executives also discussed the camera hardware improvements of the ‌iPhone 12‌ and iPhone 12 Pro, commenting that "the new wide camera, improved image fusion algorithms, make for lower noise and better detail." The specific camera advancements of the iPhone 12 Pro Max were also an area of interest:

"With the Pro Max we can extend that even further because the bigger sensor allows us to capture more light in less time, which makes for better motion freezing at night."

When asked why Apple has only chosen to increase the sensor size now with the ‌iPhone 12 Pro Max‌, McCormack revealed Apple's perspective:

"It's not as meaningful to us anymore to talk about one particular speed and feed of an image, or camera system," he said. "As we create a camera system we think about all those things, and then we think about everything we can do on the software side... You could of course go for a bigger sensor, which has form factor issues, or you can look at it from an entire system to ask if there are other ways to accomplish that. We think about what the goal is, and the goal is not to have a bigger sensor that we can brag about. The goal is to ask how we can take more beautiful photos in more conditions that people are in. It was this thinking that brought about deep fusion, night mode, and temporal image signal processing."

Read the full interview with Sweet and McCormack at PetaPixel.

Related Roundups: iPhone 12, iPhone 12 Pro
Related Forum: iPhone

Top Rated Comments

DocMultimedia Avatar
27 weeks ago
Miserable answer for why only the Pro Max got the best camera. I just can't live with the size of the Max, but want the best camera possible. I personally think the Pro line should all have the "Pro" features.
Score: 17 Votes (Like | Disagree)
citysnaps Avatar
27 weeks ago
I'm super pleased with my 12 Pro. The Pro Max was a non-starter for me not being able to put it in my shirt pocket. As I've been shooting exclusively with a phone for the past five years, that was critical. And not being to being able to navigate the screen easily with one hand sealed it as a deal killer..

The camera on the Pro is superb. Here's a recent photo:



Attachment Image
Score: 14 Votes (Like | Disagree)
AngerDanger Avatar
27 weeks ago

But did the camera array really have to look like a wonky fidget spinner?
I think it's more like a trypophobe's nightmare…

[SPOILER][/SPOILER]

Attachment Image
Score: 11 Votes (Like | Disagree)
now i see it Avatar
27 weeks ago
Every spokesman from the company is a salesman. What do people expect them to say? "Yeah the camera is a small upgrade from last year."
Score: 6 Votes (Like | Disagree)
otternonsense Avatar
27 weeks ago

Miserable answer for why only the Pro Max got the best camera. I just can't live with the size of the Max, but want the best camera possible. I personally think the Pro line should all have the "Pro" features.
Just like the 11 Pro did. It's foolish and greedy IMHO that they'd backtrack on the two best things they did for the 11 Pro: camera parity and amazing battery size/lifespan.
Score: 6 Votes (Like | Disagree)
Caliber26 Avatar
27 weeks ago

Miserable answer for why only the Pro Max got the best camera. I just can't live with the size of the Max, but want the best camera possible. I personally think the Pro line should all have the "Pro" features.
This review ('https://youtu.be/qrzCLgDplTw') will make you feel better about going with the smaller Pro. Much like the reviewer, I was hoping that the new sensor would be a noticeable upgrade over the sensor in the smaller Pro but that doesn’t seem to be the case. I still pre-ordered the Max just because of the display size but I’m feeling a little underwhelmed by the camera review.
Score: 5 Votes (Like | Disagree)

Top Stories

prosser macbook air colors stacked

Images Reveal Colorful New MacBook Air Design

Tuesday May 11, 2021 5:06 am PDT by
Apple's next MacBook Air will feature a completely new design and come in a range of colors like the 24-inch iMac, according to leaker Jon Prosser, who has now released supposedly accurate renders of the new machines based on leaked images. In a new video uploaded to YouTube channel Front Page Tech, Prosser elaborated on his previous prediction that Apple's next-generation MacBook Air models ...
m1 ipad pro chip

M1 iPad Pro Over 50% Faster Than Previous Generation in Early Benchmarks

Tuesday May 11, 2021 11:56 am PDT by
Last month, Apple introduced a new iPad Pro with the same M1 chip found in the latest Macs, and early benchmark results indicate that the M1 iPad Pro is over 50% faster than the previous-generation iPad Pro. Based on five legitimate Geekbench 5 results (here's the fifth) for the fifth-generation 12.9-inch iPad Pro with the M1 chip, the device has average single-core and multi-core scores of...
iPhone 13 Camera Backs

iPhone 13 Models Will Be Slightly Thicker and Will Have Larger Camera Bumps

Monday May 10, 2021 10:41 am PDT by
Apple's upcoming iPhone 13 models will be slightly thicker than the iPhone 12 models and will also feature larger, thicker camera bumps with lenses that protrude less, according to iPhone 13 schematics seen by MacRumors. The new iPhone 13 and 13 Pro models are expected to feature a thickness of 7.57mm, up from 7.4mm in the iPhone 12 models. That's an increase of 0.17mm, which won't be hugely ...
apple park drone june 2018 2

Apple Fires Newly Hired Ex-Facebook Product Manager Following Revelations of Past Misogynistic Comments

Thursday May 13, 2021 12:10 am PDT by
Apple has fired Antonio García Martínez, an ex-Facebook product manager and author of the controversial book "Chaos Monkeys," following public and internal calls for removal and investigation due to past misogynistic statements, The Verge reports. Apple hired Martínez earlier this week to join its ads team, however, comments that Martínez made in the past sparked condemnation from users...
imac m1 blue isolated 16x9 500k

M1 iMac is Up to 56% Faster Than Prior-Generation High-End 21.5-Inch iMac

Wednesday May 12, 2021 10:03 am PDT by
Apple's M1 iMacs are set to start delivering to customers next week, and ahead of the official launch day, benchmarks for the machines have been showing up on Geekbench, likely from reviewers who are testing them. It will come as no surprise that M1 iMac benchmarks are right on par with benchmarks for the M1 MacBook Pro, MacBook Air, and Mac mini, coming in with an average single-core score...
iPad Pro Feature

Early M1 iPad Pro Orders Now Preparing to Ship

Tuesday May 11, 2021 9:41 am PDT by
Apple will soon ship out 11 and 12.9-inch M1 iPad Pro models, according to multiple Twitter users and MacRumors readers who have seen their orders shift to "Preparing to Ship" status. So far, we haven't seen any shipment notifications, but that's the next step and is likely to happen in the near future. Apple has not provided an exact delivery date to those who ordered a new M1 iPad Pro, but ...
fortnite apple logo 2

Judge in Epic vs. Apple Case Floats Potential Compromise

Wednesday May 12, 2021 3:54 pm PDT by
In the ongoing legal battle between Apple and Epic Games, the two companies are this week calling up their expert witnesses to argue their points before Judge Yvonne Gonzalez Rogers, who will make a decision in the case after a three week trial. Expert testimony is not as exciting as some of the leaked App Store documents that were highlighted last week, especially as much of what's being...
AirTag in Envelope Feature 2

AirTag Used to Successfully Track a Mailed Package Across the UK

Wednesday May 12, 2021 8:44 am PDT by
An Apple customer in the United Kingdom has successfully used Apple's Find My network to track an AirTag as it was being sent by mail to a friend in a completely different city. Outlined in a blog post at Intego, Kirk McElhearn said he taped an AirTag to a piece of card, wrapped it inside a small bubble envelope, and then sent it on its way. Kirk lives in the small town of...
maxresdefault

Video: Make Your iPhone Last Longer With These Battery Preserving Tips

Monday May 10, 2021 1:23 pm PDT by
Maximizing battery life is something that many iPhone users deal with on a regular basis as we all want our iPhones to last as long as possible. Sometimes there are bugs in iOS that make the battery drain faster, and sometimes we just need to eke out as much as possible on a long day out and about. Subscribe to the MacRumors YouTube channel for more videos. In our latest YouTube video, MacRumo...
macos big sur ios 14 iphone 12 pro macbook air icloud drive desktop documents hero

Apple Merging 'iCloud Documents and Data' Service With iCloud Drive in May 2022

Tuesday May 11, 2021 2:36 am PDT by
Apple plans to merge its iCloud Documents and Data service with iCloud Drive starting in May of 2022, according to a support document published late last week (via MacGeneration). iCloud Drive and iCloud Documents and Data share the fundamental ability to backup data from apps. However, iCloud Documents and Data was often a cumbersome, confusing experience. In contrast, iCloud Drive is more...