Apple Executives Discuss iPhone 12 and Apple's Approach to Camera Design

iPhone Product Line Manager Francesca Sweet and Apple Camera Software Engineering Vice President Jon McCormack have provided a new interview to PetaPixel, offering insight into Apple's approach to camera design and development. Crucially, the executives explained that Apple sees camera technology as a holistic union of hardware and software.

iphone12protriplelenscamera

The interview reveals that Apple sees its main goal for smartphone photography as allowing users to "stay in the moment, take a great photo, and get back to what they're doing," without being distracted by the technology behind it.

McCormack explained that while professional photographers go through a process to fine-tune and edit their photos, Apple is attempting to refine that process down to the single action of capturing a frame.

"We replicate as much as we can to what the photographer will do in post," McCormack said. "There are two sides to taking a photo: the exposure, and how you develop it afterwards. We use a lot of computational photography in exposure, but more and more in post and doing that automatically for you. The goal of this is to make photographs that look more true to life, to replicate what it was like to actually be there."

He went on to describe how Apple uses machine learning to break down scenes into natural parts for computational image processing.

"The background, foreground, eyes, lips, hair, skin, clothing, skies. We process all these independently like you would in Lightroom with a bunch of local adjustments," McCormack continued. "We adjust everything from exposure, contrast, and saturation, and combine them all together... We understand what food looks like, and we can optimize the color and saturation accordingly to much more faithfully.

Skies are notoriously hard to really get right, and Smart HDR 3 allows us to segment out the sky and treat it completely independently and then blend it back in to more faithfully recreate what it was like to actually be there."

McCormack explained why Apple chose to include Dolby Vision HDR video capability in the iPhone 12 lineup.

"Apple wants to untangle the tangled industry that is HDR, and how they do that is leading with really great content creation tools. It goes from producing HDR video that was niche and complicated because it needed giant expensive cameras and a video suite to do, to now my 15-year-old daughter can create full Dolby Vision HDR video. So, there will be a lot more Dolby Vision content around. It's in the interest of the industry to now go and create more support."

The executives also discussed the camera hardware improvements of the ‌iPhone 12‌ and ‌iPhone 12‌ Pro, commenting that "the new wide camera, improved image fusion algorithms, make for lower noise and better detail." The specific camera advancements of the iPhone 12 Pro Max were also an area of interest:

"With the Pro Max we can extend that even further because the bigger sensor allows us to capture more light in less time, which makes for better motion freezing at night."

When asked why Apple has only chosen to increase the sensor size now with the ‌iPhone 12 Pro Max‌, McCormack revealed Apple's perspective:

"It's not as meaningful to us anymore to talk about one particular speed and feed of an image, or camera system," he said. "As we create a camera system we think about all those things, and then we think about everything we can do on the software side... You could of course go for a bigger sensor, which has form factor issues, or you can look at it from an entire system to ask if there are other ways to accomplish that. We think about what the goal is, and the goal is not to have a bigger sensor that we can brag about. The goal is to ask how we can take more beautiful photos in more conditions that people are in. It was this thinking that brought about deep fusion, night mode, and temporal image signal processing."

Read the full interview with Sweet and McCormack at PetaPixel.

Related Roundup: iPhone 12
Related Forum: iPhone

Top Rated Comments

DocMultimedia Avatar
16 months ago
Miserable answer for why only the Pro Max got the best camera. I just can't live with the size of the Max, but want the best camera possible. I personally think the Pro line should all have the "Pro" features.
Score: 17 Votes (Like | Disagree)
citysnaps Avatar
16 months ago
I'm super pleased with my 12 Pro. The Pro Max was a non-starter for me not being able to put it in my shirt pocket. As I've been shooting exclusively with a phone for the past five years, that was critical. And not being to being able to navigate the screen easily with one hand sealed it as a deal killer..

The camera on the Pro is superb. Here's a recent photo:



Attachment Image
Score: 14 Votes (Like | Disagree)
AngerDanger Avatar
16 months ago

But did the camera array really have to look like a wonky fidget spinner?
I think it's more like a trypophobe's nightmare…

[SPOILER][/SPOILER]

Attachment Image
Score: 11 Votes (Like | Disagree)
now i see it Avatar
16 months ago
Every spokesman from the company is a salesman. What do people expect them to say? "Yeah the camera is a small upgrade from last year."
Score: 6 Votes (Like | Disagree)
otternonsense Avatar
16 months ago

Miserable answer for why only the Pro Max got the best camera. I just can't live with the size of the Max, but want the best camera possible. I personally think the Pro line should all have the "Pro" features.
Just like the 11 Pro did. It's foolish and greedy IMHO that they'd backtrack on the two best things they did for the 11 Pro: camera parity and amazing battery size/lifespan.
Score: 6 Votes (Like | Disagree)
Caliber26 Avatar
16 months ago

Miserable answer for why only the Pro Max got the best camera. I just can't live with the size of the Max, but want the best camera possible. I personally think the Pro line should all have the "Pro" features.
This review ('https://youtu.be/qrzCLgDplTw') will make you feel better about going with the smaller Pro. Much like the reviewer, I was hoping that the new sensor would be a noticeable upgrade over the sensor in the smaller Pro but that doesn’t seem to be the case. I still pre-ordered the Max just because of the display size but I’m feeling a little underwhelmed by the camera review.
Score: 5 Votes (Like | Disagree)

Related Stories

galaxy s21 iphone 12 pro max

Samsung May Drop Time-of-Flight Sensor in Next Flagship Galaxy Phone

Monday April 19, 2021 1:50 am PDT by
Samsung is not planning to include a ToF (time of flight) sensor in its upcoming Galaxy S22 flagship smartphone, according to Korea IT News, due to the South Korean tech-giant believing the technology lacks a "clear advantage" for the front-end consumer. Apple first introduced ToF, or LiDAR, with the iPad Pro in 2020, and first on the iPhone with the iPhone 12 Pro and iPhone 12 Pro Max....
shot on iphone 12 apple

Apple Highlights Photos Shot by iPhone 12 Users: Portraits, Cityscapes, and More

Tuesday January 19, 2021 6:05 am PST by
Apple today shared a gallery of photos shot by customers using the iPhone 12 mini, iPhone 12, iPhone 12 Pro, and iPhone 12 Pro Max, with scenes including cityscapes, landscapes, portraits of people, and more at day and night. Shot on iPhone 12 Pro Max by "NKCHU" in China (top) and shot on iPhone 12 Pro Max by Rohit Vohra in India (bottom) iPhone 12 mini and iPhone 12 models have a dual camera ...
Untitled

iPhone 13 Pro Lineup Rumored to Include Matte Black Option, New Anti-Fingerprint Coating for Stainless Steel Edges, and More

Friday March 26, 2021 3:52 am PDT by
Despite being months away from launch, we've already seen several rumors regarding the 2021 iPhone. Now, as we inch closer to release nonetheless, new rumors point towards some design changes, new colors, and new features to expect. Image Credit: EverythingApplePro According to leaker Max Weinbach (via YouTube channel EverythingApplePro), the iPhone 13 will come with a matte black option...
iphone 12 pro max

iPhone 12 Pro Max is Among 'Best Smartphones of 2021' Says Consumer Reports

Thursday March 25, 2021 1:51 pm PDT by
Apple's iPhone 12 Pro Max is among the best smartphones of 2021 and is the top iPhone of the year, according to new smartphone rankings shared today by Consumer Reports. The faster A14 processor, OLED display, camera technology, and 5G connectivity earned it one of the top slots, with Consumer Reports recommending the 12 Pro Max over other options because of the longer battery life, larger...
eufy indoor security cameras

Major Privacy Breach as Eufy Security Camera Owners Report Seeing Other Users' Video Feeds

Monday May 17, 2021 5:02 am PDT by
Owners of Eufy home security cameras are this morning reporting seeing live and recorded feeds show up in the Eufy app from other users' cameras, in what appears to be a disturbing breach of privacy and a major malfunctioning of the company's service. As with many connected domestic security cameras, Eufy cameras offer users the ability to view real-time and recorded streams of video feeds...
iPhone OIS Feature2

Sensor-Shift Camera Stabilization Expected on All iPhone 13 Models

Thursday May 27, 2021 7:22 am PDT by
While sensor-shift optical image stabilization is currently limited to the iPhone 12 Pro Max, the feature will be expanded to all iPhone 13 models later this year, according to Taiwanese supply chain publication DigiTimes. From the report, with emphasis added:The VCM makers mainly deliver shipments for Android handsets in the first half of the year, but such shipments are expected to be...
photos app metadata

iOS 15 Photos App Now Displays EXIF Metadata for Images

Monday June 7, 2021 2:48 pm PDT by
If you've ever wanted to see the EXIF data for a photo right on your iPhone Photos app, then you're going to want to install the iOS 15 update right away. With iOS 15, each image in the Photos app has a new "Info" button available that displays image format, the details of the camera used to capture it, and the location where it was taken. Prior to now, there was no way to view this...
ipad pro macro feature

Halide Developer Highlights Hidden Macro Camera Feature in 2021 iPad Pro

Wednesday May 26, 2021 12:16 pm PDT by
When Apple releases a new product with upgraded camera technology, the developers behind popular photography app Halide often take a deep dive into the revamped camera features to provide us with some insight into how things work behind the scenes. Halide developer Sebastiaan de With today shared a look at the cameras in the new 11 and 12.9-inch iPad Pro models, uncovering a hidden macro...

Popular Stories

safari icon blue banner

Safari Bug Allows Websites to Track Your Recent Browsing Activity in Real Time [Updated]

Sunday January 16, 2022 3:37 pm PST by
A bug in WebKit's implementation of a JavaScript API called IndexedDB can reveal your recent browsing history and even your identity, according to a blog post shared on Friday by browser fingerprinting service FingerprintJS. In a nutshell, the bug allows any website that uses IndexedDB to access the names of IndexedDB databases generated by other websites during a user's browsing session....
iPhone 14 Mock pill and hole thumb

ProMotion Now Expected to Remain Exclusive to iPhone 14 Pro Models, Not Expand to Entire Lineup

Sunday January 16, 2022 8:56 am PST by
Continuing the tradition set with the iPhone 13 Pro, only the highest-end iPhone 14 models will feature Apple's ProMotion display technology, according to a respected display analyst. Ross Young, who on multiple occasions has detailed accurate information about Apple's future products, said in a tweet that ProMotion will not be expanded to the entire iPhone 14 lineup and will remain...
iPad Air Feature 2 green

New Apple Products Filed in Regulatory Database, Likely Including New iPhone SE and iPad Air

Tuesday January 18, 2022 6:11 am PST by
Apple today filed unreleased iPhone and iPad models in the Eurasian Economic Commission database, as spotted by French blog Consomac. The filings likely represent the rumored third-generation iPhone SE, fifth-generation iPad Air, and potentially more. The unreleased iPhone models have the identifiers A2595, A2783, and A2784, while the unreleased iPad models have the identifiers A2588, A2589, ...
AirPods 3 New Firmware Feature

Apple Updates AirPods 3 Firmware to Version 4C170

Tuesday January 18, 2022 11:46 am PST by
Apple today released a new 4C170 firmware update for the AirPods 3, an update from the prior 4C165 that was made available in December. Apple does not offer details on what's included in new firmware updates for the AirPods‌, so we don't know what improvements or bug fixes the new firmware brings. There is no standard way to upgrade the ‌AirPods‌‌ software, but firmware is...
iphone 5g mmwave

U.S. Airlines Warn of 'Catastrophic' Crisis With Impending 5G Rollout, AT&T and Verizon Agree to Delay Around Airports

Tuesday January 18, 2022 10:35 am PST by
Verizon and AT&T's upcoming rollout of new C-Band 5G technology could cause chaos and lead to widespread delays of passenger and cargo flights, major U.S. airlines said on Monday in a letter sent to the White House National Economic Council, the FAA, and the FCC (via Reuters). "Unless our major hubs are cleared to fly, the vast majority of the traveling and shipping public will essentially...
iphone se 2020 top

iPhone SE With Larger 5.7-Inch Display May Launch in 2023, 'iPhone SE+ 5G' Also Rumored

Monday January 17, 2022 6:46 am PST by
Apple is planning to release a fourth-generation iPhone SE with a larger 5.7-inch display as early as 2023, according to display industry consultant Ross Young, who has proven to be a reliable source of information for future Apple products. The fourth-generation iPhone SE has until now been rumored to launch in 2024, but Young now says a 2023 release is looking more likely....
tesla carplay solution

Developer Showcases Apple CarPlay Workaround for Teslas

Monday January 17, 2022 7:24 am PST by
A Tesla Model 3 owner has resorted to a workaround to implement Apple CarPlay in his vehicle, amid no sign of official support from Tesla (via Tesla North). Apple CarPlay and Apple Music support are among the most-requested Tesla features, but with no indication that Tesla is willing to implement Apple CarPlay in its vehicles, Polish developer Michał Gapiński took matters into his own...
ipad air 4 video

New iPad Air Rumored to Launch This Spring With A15 Chip, 5G, Center Stage Camera, and More

Saturday January 15, 2022 8:05 pm PST by
Apple is planning to release a fifth-generation iPad Air with similar features as the sixth-generation iPad mini, including an A15 Bionic chip, 12-megapixel Ultra Wide front camera with Center Stage support, 5G for cellular models, and Quad-LED True Tone flash, according to Japanese blog Mac Otakara. Citing reliables sources in China, the report claims that the new iPad Air could be...