Apple Aims to Prevent Blurry or Underexposed iPhone Photos with Automatic Image Buffering and Comparison

iphone_camera_view_patentA newly-published patent application from Apple discovered by AppleInsider describes methods that would allow an iPhone to buffer a series of photos before the user presses the shutter button for the device's camera and then automatically select the best one.

It is not uncommon for camera-shake or a less than optimal angle to result in blurry or dark photos in low-light conditions, even on the relatively capable camera on the iPhone. What the patent allows for is for the camera to start taking a series of photos before the user presses the shutter release, then automatically compare them with the one taken at the moment the button was pressed. If the system judges that one of the buffered photos is better, it stores that one in place of the one taken at shutter release.

In particular, the system seeks to minimize the camera shake that can accompany press the iPhone's volume button or tapping the screen to trigger the shutter by capturing images before the button or screen is even touched.

The algorithm described in the patent application uses a scoring system which measures contrast (the usual method used to judge focus), image resolution, dynamic range (the balance of light and dark tones in the image) and color rendering properties to determine which is the best version of the photo. The others are then discarded.

While the selection of the image is an automatic process, the system could allow the user to confirm the device's choice of the best available photo.

The patent application was filed in October of last year but references an earlier application filed in 2009, so it is possible that elements of this approach are used in current iPhones and iPads, although it is clear that the current Camera app for iOS does not include all aspects of the system.

Tag: patent

Top Rated Comments

(View all)
Avatar
101 months ago
Don't other smartphone cameras already do this?
Score: 9 Votes (Like | Disagree)
Avatar
101 months ago
i like this on my friends galaxy s3
Score: 5 Votes (Like | Disagree)
Avatar
101 months ago
Massive prior art on this... it's a fantastic example of how the US patent office truly sucks.

Time for Apple to start innovating and stop rehashing other people's ideas...
Score: 4 Votes (Like | Disagree)
Avatar
101 months ago

Don't other smartphone cameras already do this?


Yes, many other physical cameras and apps already do this. They take quick series of pictures either side of the shutter button press then attempt to work out which one is the best by analysing them for motion blur. The one with the least motion blur is then saved out. It's often mis-marketed as an "image stabiliser" function but effectively achieves the same thing most of the time.

Some cameras with face detection go further and attempt to discard photos where people are blinking. Chances are, it's taken 10 photos either side of the shutter press, that at least one will be crisp with nobody blinking. I'm not sure why Apple are now trying to patent this common technique - it's hardly new.
Score: 4 Votes (Like | Disagree)
Avatar
101 months ago

Don't other smartphone cameras already do this?

Score: 4 Votes (Like | Disagree)
Avatar
101 months ago
I think I'd be wary of such a feature. I take pictures all the time of my kids, friends, dog, etc. Getting everyone to look at the camera at the same time or with eyes open is a real pain. I'm not sure I want an algorithm choosing to keep the best photo at the expense of what I mentioned above. EVEN WITH the ability to accept or reject, if I'm shooting a bunch of photos all at once (say at my kids sporting events) I may not have time to review and choose the one I want to keep. I'm not sure there's a great way to get around these issues other than perhaps to have an 'on-off' toggle or to have the ability to always to photos in this mode and then be able to decide at a later time which one to keep.
Score: 3 Votes (Like | Disagree)

Top Stories

First iPhone 12 Mini Hands-On Video Surfaces [Update: Video Pulled]

Wednesday October 28, 2020 1:21 pm PDT by
Apple's iPhone 12 mini and the iPhone 12 Pro Max aren't set to be available until November 13, but a Romanian YouTuber got his hands on the iPhone 12 mini and showed it off today, offering a size comparison between the iPhone 12 and the 12 mini along with going over some of the device's features. The iPhone 12 mini is identical to the iPhone 12 in design and functionality, but it has a...

Apple References Unreleased 2020 16-Inch MacBook Pro in Boot Camp Update

Monday October 26, 2020 8:42 am PDT by
Last week, Apple released an update for Boot Camp, its utility for running Windows on a Mac. While this update would typically be unremarkable, several of our readers noticed that the release notes reference an unreleased 2020 model of the 16-inch MacBook Pro. While this could easily be a mistake, the 16-inch MacBook Pro is nearly a year old, so it is certainly a worthy candidate for a...

After Mocking Apple, Samsung May Remove Power Adapter From Galaxy S21 Box

Tuesday October 27, 2020 4:29 pm PDT by
Samsung's Galaxy S21, coming in 2021, may not include a power adapter or headphones in the box, according to reports from Korean media sites highlighted by SamMobile. Rumors earlier this year also said that Samsung was considering removing these accessories from future smartphone models, but that didn't stop Samsung from mocking Apple for selling the iPhone 12 models without a power adapter...

Report: Apple Silicon iMac Featuring Desktop Class 'A14T' Chip Coming First Half of 2021

Tuesday October 27, 2020 4:14 am PDT by
The first iMac powered by Apple Silicon is set to arrive in the first half of next year and will feature a desktop class "A14T" chip, according to Chinese-language newspaper The China Times. Codenamed "Mt. Jade," Apple's first custom-made desktop processor will be twinned with its first self-developed GPU, codenamed "Lifuka," both of which are being produced using TSMC's 5-nanometer process, ...

iPhone 12 Ceramic Shield Still 'Scratches at Level 6 With Deeper Grooves at Level 7' in Mohs Hardness Test

Wednesday October 28, 2020 7:10 am PDT by
iPhone 12 and iPhone 12 Pro models feature a new Ceramic Shield front cover that is "tougher than any smartphone glass," according to Apple, but the displays on the devices still have similar scratch resistance as previous iPhones based on a new test. Zack Nelson today shared his much-anticipated iPhone 12 Pro durability test on his YouTube channel JerryRigEverything, and based on the Mohs...

2020 iPad Air vs. iPad Pro: Hands-On Comparison

Tuesday October 27, 2020 3:03 pm PDT by
Apple announced the new 2020 fourth-generation iPad Air in September, but the new tablets just started shipping out to customers last Friday. We picked one up and thought we'd do a hands-on comparison with the iPad Pro, which was last updated in March, because both tablets are about as powerful and share many similarities. Subscribe to the MacRumors YouTube channel for more videos. Design and ...

MagSafe Charger Only Charges at Full 15W Speeds With Apple's 20W Power Adapter [Updated]

Monday October 26, 2020 3:38 pm PDT by
Alongside the iPhone 12 and 12 Pro models, Apple introduced a new MagSafe charger that attaches to the magnetic ring in the back of the devices, providing up to 15W of charging power, which is double the speed of the 7.5W Qi-based wireless charging maximum. Apple does not provide a power adapter with the $39 MagSafe charger, requiring users to supply their own USB-C compatible option. Apple...

Apple Files Mystery 'Personal Computer' With Placeholder 'B2002' Name in Bluetooth Product Database

Tuesday October 27, 2020 12:36 pm PDT by
Last week, a listing appeared in the Bluetooth product database for an Apple product with a placeholder name "B2002" and a model number of "TBD." MacRumors was alerted to the listing by health and fitness tech website MyHealthyApple. The product is filed under the "personal computer" category, which Apple has used for previous Mac and iPad listings in the database, so it is hard to pinpoint...

Apple Releases First macOS Big Sur 11.0.1 Beta to Developers [Update: Public Beta Available]

Wednesday October 28, 2020 10:15 am PDT by
Apple today seeded a new macOS Big Sur 11.0.1 beta to developers for testing purposes, with the new beta replacing the existing macOS Big Sur 11 beta 10 update that was released two weeks ago. The macOS Big Sur beta can be downloaded through the Apple Developer Center and once the appropriate profile is installed, subsequent betas will be available through the Software Update mechanism in...

iPhone 12 Models Might Support Reverse Charging of Future Apple Accessories According to FCC Filing

Tuesday October 27, 2020 6:25 pm PDT by
iPhone 12 models could have an inactive wireless charging feature for accessories, according to an FCC filing discovered by VentureBeat's Jeremy Horwitz. In the filing, Apple said that 2020 iPhones support a wireless charging function that will seemingly be enabled for at least one future Apple accessory:In addition to being able to be charged by a desktop WPT charger (puck), 2020 iPhones...