Apple Watch Proves Most Accurate at Measuring Heart Rate in New Fitness Tracker Study

In a new study comparing the accuracy of seven different fitness trackers, the Apple Watch was found to have the lowest margin of error when measuring heart rate, beating the Basis Peak, Fitbit Surge, Microsoft Band, Mio Alpha 2, PulseOn, and Samsung Gear S2.

Researchers set out to determine the accuracy of wrist-worn devices at measuring both heart rate and energy expenditure, aka calories burned via physical activity. 60 volunteers participated, including 29 males and 31 females, each of whom wore several fitness trackers and completed activities like cycling, running, and walking.

applewatchstudy1
Data gathered by the fitness devices was compared against a "gold standard" tracking method, which included an electrocardiograph (ECG) for measuring heart rate and clinical grade indirect calorimetry (measuring oxygen and carbon dioxide expelled when breathing) for measuring calories burned. An error rate of 5 percent was determined to be within acceptable limits.

Across all of the modes of activity, the Apple Watch had the lowest median heart rate error at 2 percent (1.2% to 2.8%), while the Samsung Gear S2 had the highest error rate at 6.8 percent (4.6% to 9%). The Apple Watch was also notably more accurate at measuring heart rate during the walking test than competing products.

For the walking task, three of the devices achieved a median error rate below 5%: the Apple Watch, 2.5% (1.1%-3.9%); the PulseOn, 4.9% (1.4%-8.6%); and the Microsoft Band, 5.6% (4.9%-6.3%). The remaining four devices had median error between 6.5% and 8.8%.

When it came to measuring calories, no device, Apple Watch included, managed to accurately determine how many calories were burned through activity. Median error rates across all devices and tasks ranged from 27.4 percent (Fitbit Surge) to 92.6 (PulseOn). Though no device was accurate, the Apple Watch did the best at estimating energy expenditure.

applewatchstudy2
Overall, researchers found that most of the fitness trackers tested were able to measure heart rate with an acceptable error level in a laboratory setting, but calorie estimates are largely inaccurate.

There are three principal findings from the current study. In a diverse group of individuals: (1) most wrist-worn monitoring devices report HR with acceptable error under controlled laboratory conditions of walking, running and cycling; (2) no wrist-worn monitoring devices report EE within an acceptable error range under these conditions; (3) of the devices tested, the Apple Watch had the most favorable error profile while the Samsung Gear S2 had the least favorable error profile.

The full study, conducted by Stanford University and the Swedish School of Sport and Health Services, is available in the Journal of Personalized Medicine.

Related Roundup: Apple Watch Series 7
Related Forum: Apple Watch

Top Rated Comments

OldSchoolMacGuy Avatar
56 months ago
Apple puts a lot into R&D and calibration. They know they're the biggest target when it comes to accuracy. Most wouldn't care if FitBit or Samsung aren't overly accurate but you'd see headlines everywhere if Apple were off.

Here's an interesting read on the level technicality they went through to make it incredibly accurate at telling time. It's 4x more accurate than the iPhone actually.

http://mashable.com/2015/12/30/apple-watch-synchronized/#EIku7j18gGq3
Score: 21 Votes (Like | Disagree)
Seoras Avatar
56 months ago
So I read the article. Apple does something better than the competition. Then, just for laughs, I come here to the forum to read the howling and gnashing of teeth from the haters who want to tear them down.
I'm never disappointed, you guys are so entertaining! (& so full of it.) :)
Score: 20 Votes (Like | Disagree)
NightStorm Avatar
56 months ago
Why don't these studies ever compare the Apple Watch with more hardcore fitness watches like those from Garmin or Sunto?
Score: 17 Votes (Like | Disagree)
satchmo Avatar
56 months ago
Why don't these studies ever compare the Apple Watch with more hardcore fitness watches like those from Garmin or Sunto?
Exactly. Garmin is such a giant in the fitness field, that to leave them out seems suspicious.
Score: 13 Votes (Like | Disagree)
jclo Avatar
56 months ago
Why don't these studies ever compare the Apple Watch with more hardcore fitness watches like those from Garmin or Sunto?
I'm not sure why the study didn't include a Garmin product. This was how the trackers were selected:

"Following a comprehensive literature and online search, 45 manufacturers of wrist-worn devices were identified. Criteria for inclusion included: wrist-worn watch or band; continuous measurement of HR; stated battery life >24 h; commercially available direct to consumer at the time of the study; one device per manufacturer. Eight devices met the criteria; Apple Watch; Basis Peak; ePulse2; Fitbit Surge; Microsoft Band; MIO Alpha 2; PulseOn; and Samsung Gear S2."
Score: 11 Votes (Like | Disagree)
ErikGrim Avatar
56 months ago
Why don't these studies ever compare the Apple Watch with more hardcore fitness watches like those from Garmin or Sunto?
Especially galling since they bothered to include the discontinued Microsoft Band.
Score: 9 Votes (Like | Disagree)

Top Stories

iphone 12 colors 2021

iPhone 12 Colors: Deciding on The Right Color

Thursday November 5, 2020 8:35 am PST by
The iPhone 12 and iPhone 12 Pro arrived last October in a range of color options, with entirely new hues available on both devices, as well as some popular classics. The 12 and 12 Pro have different color choices, so if you have your heart set on a particular shade, you might not be able to get your preferred model in that color. iPhone 12 mini and iPhone 12 The iPhone 12 mini and iPhone 12...
iPhone 13 Dummy Thumbnail 2

Full iPhone 13 Feature Breakdown: Everything Rumors Say We Can Expect

Tuesday August 31, 2021 7:50 am PDT by
With the launch of Apple's iPhone 13 lineup believed to be just a few weeks away, we have compiled all of the coherent rumors from our coverage over the past year to build a full picture of the features and upgrades coming to the company's new smartphones. For clarity, only explicit improvements, upgrades, and new features compared to the iPhone 12 lineup are listed. It is worth noting that...
original iphone

Phil Schiller Says iPhone Was 'Earth-Shattering' Ten Years Ago and Remains 'Unmatched' Today

Monday January 9, 2017 7:15 am PST by
To commemorate the tenth anniversary of the iPhone, Apple marketing chief Phil Schiller sat down with tech journalist Steven Levy for a wide-ranging interview about the smartphone's past, present, and future. The report first reflects upon the iPhone's lack of support for third-party apps in its first year. The argument inside Apple was split between whether the iPhone should be a closed...
macbook air deals

Deals: Amazon Drops Price of 256GB M1 MacBook Air to New Low of $849.99 ($149 Off)

Friday August 27, 2021 6:16 am PDT by
Amazon today introduced new low prices on the M1 MacBook Air for both 256GB and 512GB storage options. To start, you can get the 256GB model for $849.99, down from an original price of $999.00. Note: MacRumors is an affiliate partner with Amazon. When you click a link and make a purchase, we may receive a small payment, which helps us keep the site running. Only Silver and Gold are...
iCloud General Feature

iCloud+'s New Custom Email Domain Feature Now Available in Beta

Wednesday August 25, 2021 7:48 am PDT by
Starting with iOS 15, iPadOS 15, and macOS Monterey, users with a paid iCloud+ storage plan can personalize their iCloud email address with a custom domain name, such as johnny@appleseed.com, and the feature is now available in beta. iCloud+ subscribers interested in setting up a custom email domain can visit the beta.icloud.com website, select "Account Settings" under their name, and select ...
iPhone 13 Dummy Thumbnail 2

Kuo: iPhone 13 to Feature LEO Satellite Communications to Make Calls and Texts Without Cellular Coverage

Sunday August 29, 2021 7:39 am PDT by
The iPhone 13 will feature low earth orbit (LEO) satellite communication connectivity to allow users to make calls and send messages in areas without 4G or 5G coverage, according to the reliable analyst Ming-Chi Kuo. In a note to investors, seen by MacRumors, Kuo explained that the iPhone 13 lineup will feature hardware that is able to connect to LEO satellites. If enabled with the relevant...
maxresdefault

New MacBook Pro Models Coming at WWDC, Suggests Leaker

Monday May 24, 2021 1:27 pm PDT by
New MacBook Pro models are coming at WWDC, according to leaker Jon Prosser who has a mixed track record when it comes to predicting Apple's plans. Subscribe to the MacRumors YouTube channel for more videos. Prosser provided no additional information, but there are new 14 and 16-inch MacBook Pro models in the works. The new MacBook Pros will feature the most radical redesign to the MacBook Pro ...
omg lightning cable comparison

Security Researcher Develops Lightning Cable With Hidden Chip to Steal Passwords

Thursday September 2, 2021 6:59 am PDT by
A normal-looking Lightning cable that can used to steal data like passwords and send it to a hacker has been developed, Vice reports. The "OMG Cable" compared to Apple's Lightning to USB cable. The "OMG Cable" works exactly like a normal Lightning to USB cable and can log keystrokes from connected Mac keyboards, iPads, and iPhones, and then send this data to a bad actor who could be over a...
ted lasso notchless phone

No, That Notchless iPhone Spotted in 'Ted Lasso' Isn't the iPhone 13

Tuesday August 31, 2021 2:15 am PDT by
Recent sightings of a notchless iPhone in highly popular Apple TV+ comedy "Ted Lasso" have led to sensational headlines suggesting this is a canny bit of product placement on Apple's part and that the iPhone 13 will be notchless. In actuality – and this could go without saying – the phone in question is very likely just showing a poorly superimposed display added in post-production. Notchless ...
calculatorapp

iOS 11 Bug: Typing 1+2+3 Quickly in the Calculator App Won't Get You 6

Tuesday October 24, 2017 2:03 pm PDT by
A bug in the built-in Calculator app in iOS 11 is getting some major attention this week, despite the fact that it's been around since iOS 11 was in beta testing. At issue is a calculator animation that causes some symbols to be ignored when calculations are entered in rapid succession. You can try it for yourself: Type 1+2+3 and then the equals sign into the Calculator app quickly. Due to...