Apple Executives Discuss iPhone 12 and Apple's Approach to Camera Design

iPhone Product Line Manager Francesca Sweet and Apple Camera Software Engineering Vice President Jon McCormack have provided a new interview to PetaPixel, offering insight into Apple's approach to camera design and development. Crucially, the executives explained that Apple sees camera technology as a holistic union of hardware and software.

iphone12protriplelenscamera

The interview reveals that Apple sees its main goal for smartphone photography as allowing users to "stay in the moment, take a great photo, and get back to what they're doing," without being distracted by the technology behind it.

McCormack explained that while professional photographers go through a process to fine-tune and edit their photos, Apple is attempting to refine that process down to the single action of capturing a frame.

"We replicate as much as we can to what the photographer will do in post," McCormack said. "There are two sides to taking a photo: the exposure, and how you develop it afterwards. We use a lot of computational photography in exposure, but more and more in post and doing that automatically for you. The goal of this is to make photographs that look more true to life, to replicate what it was like to actually be there."

He went on to describe how Apple uses machine learning to break down scenes into natural parts for computational image processing.

"The background, foreground, eyes, lips, hair, skin, clothing, skies. We process all these independently like you would in Lightroom with a bunch of local adjustments," McCormack continued. "We adjust everything from exposure, contrast, and saturation, and combine them all together... We understand what food looks like, and we can optimize the color and saturation accordingly to much more faithfully.

Skies are notoriously hard to really get right, and Smart HDR 3 allows us to segment out the sky and treat it completely independently and then blend it back in to more faithfully recreate what it was like to actually be there."

McCormack explained why Apple chose to include Dolby Vision HDR video capability in the ‌iPhone‌ 12 lineup.

"Apple wants to untangle the tangled industry that is HDR, and how they do that is leading with really great content creation tools. It goes from producing HDR video that was niche and complicated because it needed giant expensive cameras and a video suite to do, to now my 15-year-old daughter can create full Dolby Vision HDR video. So, there will be a lot more Dolby Vision content around. It's in the interest of the industry to now go and create more support."

The executives also discussed the camera hardware improvements of the ‌iPhone‌ 12 and ‌iPhone‌ 12 Pro, commenting that "the new wide camera, improved image fusion algorithms, make for lower noise and better detail." The specific camera advancements of the iPhone 12 Pro Max were also an area of interest:

"With the Pro Max we can extend that even further because the bigger sensor allows us to capture more light in less time, which makes for better motion freezing at night."

When asked why Apple has only chosen to increase the sensor size now with the ‌iPhone 12 Pro Max‌, McCormack revealed Apple's perspective:

"It's not as meaningful to us anymore to talk about one particular speed and feed of an image, or camera system," he said. "As we create a camera system we think about all those things, and then we think about everything we can do on the software side... You could of course go for a bigger sensor, which has form factor issues, or you can look at it from an entire system to ask if there are other ways to accomplish that. We think about what the goal is, and the goal is not to have a bigger sensor that we can brag about. The goal is to ask how we can take more beautiful photos in more conditions that people are in. It was this thinking that brought about deep fusion, night mode, and temporal image signal processing."

Read the full interview with Sweet and McCormack at PetaPixel.

Related Forum: iPhone

Popular Stories

Apple Intelligence General Feature

Apple Intelligence Features Not Coming to European Union at Launch Due to DMA

Friday June 21, 2024 9:44 am PDT by
Apple today said that European customers will not get access to the Apple Intelligence, iPhone Mirroring, and SharePlay Screen Sharing features that are coming to the iPhone, iPad, and Mac this September due to regulatory issues related to the Digital Markets Act. In a statement to Financial Times, Apple said that there will be a delay as it works to figure out how to make the new...
Apple WWDC24 Apple Intelligence hero 240610

Apple Explains iPhone 15 Pro Requirement for Apple Intelligence

Wednesday June 19, 2024 4:48 am PDT by
With iOS 18, iPadOS 18, and macOS Sequoia, Apple is introducing a new personalized AI experience called Apple Intelligence that uses on-device, generative large-language models to enhance the user experience across iPhone, iPad, and Mac. These new AI features require Apple's latest iPhone 15 Pro and iPhone 15 Pro Max models to work, while only Macs and iPads with M1 or later chips will...
amazon echo dot

Amazon Could Charge Up to $10/Month for Alexa

Friday June 21, 2024 2:55 pm PDT by
Apple competitor Amazon is working on a revamp of its Alexa assistant, and the new version could cost up $10 per month, according to a report from Reuters. The upcoming version of Alexa will support conversational generative AI, and Amazon is planning for two tiers of service. There will be a free tier and a second, premium tier that is priced at $5 at a minimum, with Amazon considering...
General Spotify Feature

Spotify Launches Cheaper $10.99/Month Premium Plan Without Audiobooks

Friday June 21, 2024 4:22 pm PDT by
Spotify today announced the launch of a new Basic paid plan that offers a small discount for dropping access to audiobooks. Priced at $10.99 per month, the Basic option includes all of the music benefits of Spotify like ad-free playback, but without added monthly audiobook listening time. The $11.99 standard Premium Individual plan that Spotify offers includes ad-free playback and 15 hours...
iPhone 16 Pro Max Generic Feature 2

5 Biggest Changes Rumored for iPhone 16 Pro Max

Wednesday June 19, 2024 5:00 am PDT by
Given Apple's rumored plan to add an all-new high-end tier to its iPhone 17 series in 2025, this could be the year for Apple to bring its boldest "Pro Max" model to the table — the kind of iPhone 16 upgrade that stands tall above its siblings, both figuratively and literally. If you have been holding out for the iPhone 16 Pro Max, here are five of the biggest changes rumored to be coming...

Top Rated Comments

DocMultimedia Avatar
47 months ago
Miserable answer for why only the Pro Max got the best camera. I just can't live with the size of the Max, but want the best camera possible. I personally think the Pro line should all have the "Pro" features.
Score: 17 Votes (Like | Disagree)
citysnaps Avatar
47 months ago
I'm super pleased with my 12 Pro. The Pro Max was a non-starter for me not being able to put it in my shirt pocket. As I've been shooting exclusively with a phone for the past five years, that was critical. And not being to being able to navigate the screen easily with one hand sealed it as a deal killer..

The camera on the Pro is superb. Here's a recent photo:



Attachment Image
Score: 14 Votes (Like | Disagree)
AngerDanger Avatar
47 months ago

But did the camera array really have to look like a wonky fidget spinner?
I think it's more like a trypophobe's nightmare…

[SPOILER][/SPOILER]

Attachment Image
Score: 11 Votes (Like | Disagree)
now i see it Avatar
47 months ago
Every spokesman from the company is a salesman. What do people expect them to say? "Yeah the camera is a small upgrade from last year."
Score: 6 Votes (Like | Disagree)
otternonsense Avatar
47 months ago

Miserable answer for why only the Pro Max got the best camera. I just can't live with the size of the Max, but want the best camera possible. I personally think the Pro line should all have the "Pro" features.
Just like the 11 Pro did. It's foolish and greedy IMHO that they'd backtrack on the two best things they did for the 11 Pro: camera parity and amazing battery size/lifespan.
Score: 6 Votes (Like | Disagree)
Caliber26 Avatar
47 months ago

Miserable answer for why only the Pro Max got the best camera. I just can't live with the size of the Max, but want the best camera possible. I personally think the Pro line should all have the "Pro" features.
This review ('https://youtu.be/qrzCLgDplTw') will make you feel better about going with the smaller Pro. Much like the reviewer, I was hoping that the new sensor would be a noticeable upgrade over the sensor in the smaller Pro but that doesn’t seem to be the case. I still pre-ordered the Max just because of the display size but I’m feeling a little underwhelmed by the camera review.
Score: 5 Votes (Like | Disagree)