Apple Watch Proves Most Accurate at Measuring Heart Rate in New Fitness Tracker Study

In a new study comparing the accuracy of seven different fitness trackers, the Apple Watch was found to have the lowest margin of error when measuring heart rate, beating the Basis Peak, Fitbit Surge, Microsoft Band, Mio Alpha 2, PulseOn, and Samsung Gear S2.

Researchers set out to determine the accuracy of wrist-worn devices at measuring both heart rate and energy expenditure, aka calories burned via physical activity. 60 volunteers participated, including 29 males and 31 females, each of whom wore several fitness trackers and completed activities like cycling, running, and walking.

applewatchstudy1
Data gathered by the fitness devices was compared against a "gold standard" tracking method, which included an electrocardiograph (ECG) for measuring heart rate and clinical grade indirect calorimetry (measuring oxygen and carbon dioxide expelled when breathing) for measuring calories burned. An error rate of 5 percent was determined to be within acceptable limits.

Across all of the modes of activity, the Apple Watch had the lowest median heart rate error at 2 percent (1.2% to 2.8%), while the Samsung Gear S2 had the highest error rate at 6.8 percent (4.6% to 9%). The Apple Watch was also notably more accurate at measuring heart rate during the walking test than competing products.

For the walking task, three of the devices achieved a median error rate below 5%: the Apple Watch, 2.5% (1.1%-3.9%); the PulseOn, 4.9% (1.4%-8.6%); and the Microsoft Band, 5.6% (4.9%-6.3%). The remaining four devices had median error between 6.5% and 8.8%.

When it came to measuring calories, no device, Apple Watch included, managed to accurately determine how many calories were burned through activity. Median error rates across all devices and tasks ranged from 27.4 percent (Fitbit Surge) to 92.6 (PulseOn). Though no device was accurate, the Apple Watch did the best at estimating energy expenditure.

applewatchstudy2
Overall, researchers found that most of the fitness trackers tested were able to measure heart rate with an acceptable error level in a laboratory setting, but calorie estimates are largely inaccurate.

There are three principal findings from the current study. In a diverse group of individuals: (1) most wrist-worn monitoring devices report HR with acceptable error under controlled laboratory conditions of walking, running and cycling; (2) no wrist-worn monitoring devices report EE within an acceptable error range under these conditions; (3) of the devices tested, the Apple Watch had the most favorable error profile while the Samsung Gear S2 had the least favorable error profile.

The full study, conducted by Stanford University and the Swedish School of Sport and Health Services, is available in the Journal of Personalized Medicine.

Related Roundup: Apple Watch Series 8
Buyer's Guide: Apple Watch (Neutral)
Related Forum: Apple Watch

Top Rated Comments

OldSchoolMacGuy Avatar
75 months ago
Apple puts a lot into R&D and calibration. They know they're the biggest target when it comes to accuracy. Most wouldn't care if FitBit or Samsung aren't overly accurate but you'd see headlines everywhere if Apple were off.

Here's an interesting read on the level technicality they went through to make it incredibly accurate at telling time. It's 4x more accurate than the iPhone actually.

http://mashable.com/2015/12/30/apple-watch-synchronized/#EIku7j18gGq3
Score: 21 Votes (Like | Disagree)
Seoras Avatar
75 months ago
So I read the article. Apple does something better than the competition. Then, just for laughs, I come here to the forum to read the howling and gnashing of teeth from the haters who want to tear them down.
I'm never disappointed, you guys are so entertaining! (& so full of it.) :)
Score: 20 Votes (Like | Disagree)
NightStorm Avatar
75 months ago
Why don't these studies ever compare the Apple Watch with more hardcore fitness watches like those from Garmin or Sunto?
Score: 17 Votes (Like | Disagree)
satchmo Avatar
75 months ago
Why don't these studies ever compare the Apple Watch with more hardcore fitness watches like those from Garmin or Sunto?
Exactly. Garmin is such a giant in the fitness field, that to leave them out seems suspicious.
Score: 13 Votes (Like | Disagree)
jclo Avatar
75 months ago
Why don't these studies ever compare the Apple Watch with more hardcore fitness watches like those from Garmin or Sunto?
I'm not sure why the study didn't include a Garmin product. This was how the trackers were selected:

"Following a comprehensive literature and online search, 45 manufacturers of wrist-worn devices were identified. Criteria for inclusion included: wrist-worn watch or band; continuous measurement of HR; stated battery life >24 h; commercially available direct to consumer at the time of the study; one device per manufacturer. Eight devices met the criteria; Apple Watch; Basis Peak; ePulse2; Fitbit Surge; Microsoft Band; MIO Alpha 2; PulseOn; and Samsung Gear S2."
Score: 11 Votes (Like | Disagree)
ErikGrim Avatar
75 months ago
Why don't these studies ever compare the Apple Watch with more hardcore fitness watches like those from Garmin or Sunto?
Especially galling since they bothered to include the discontinued Microsoft Band.
Score: 9 Votes (Like | Disagree)

Popular Stories

iOS 16

iOS 16.3 Now Available for Your iPhone With These 4 New Features

Friday February 3, 2023 1:13 pm PST by
Apple released iOS 16.3 in late January following nearly six weeks of beta testing. The software update is available for the iPhone 8 and newer, and while it is a relatively minor update, it still includes a handful of new features, changes, and bug fixes. Below, we've recapped new features in iOS 16.3, including support for physical security keys as a two-factor authentication option for...
ipad air purple

Deals: M1 iPad Air Hits Record-Low Prices at TigerDirect, Starting at $313.99 (48% Off)

Saturday February 4, 2023 10:05 am PST by
Online retailer TigerDirect has slashed pricing on the M1 iPad Air in several colors, offering the base 64GB configuration for just $313.99 in Purple and Pink. Note: MacRumors is an affiliate partner with TigerDirect. When you click a link and make a purchase, we may receive a small payment, which helps us keep the site running. That's a savings of 48% compared to Apple's normal $599.00...
Apple Silicon Teal Feature

The Next Big Apple Silicon Device May Not Be a Mac or iPad

Wednesday February 1, 2023 3:57 am PST by
Apple's next device with an Apple silicon chip may not be a Mac or an iPad, but rather an advanced external display, according to recent reports. The display, which is rumored to arrive this year, is expected to sit somewhere between the $1,599 Studio Display and the $4,999 Pro Display XDR – but more exact information about the device's positioning and price point is as yet unknown. While ...
iPhone 14 Pro Purple Side Perspective Feature Purple

Gurman: Apple Considering New High-End iPhone Alongside Pro and Pro Max

Sunday February 5, 2023 6:07 am PST by
Apple has discussed selling a new top-of-the-line iPhone alongside the Pro and Pro Max models in 2024 at the earliest, according to Bloomberg's Mark Gurman. Based on this timeframe, the device would be part of the iPhone 16 lineup or later. In a September 2022 edition of his weekly "Power On" newsletter, Gurman said there was "potential" for an iPhone 15 Ultra to replace the iPhone 15 Pro...
HomePod 2 White and Midnight Feature Purple Blue

Apple Explains Why HomePod Was Released Again, Wi-Fi 4 Limitation, and More

Thursday February 2, 2023 7:57 am PST by
Apple's VP of hardware engineering Matthew Costello and product marketing employee Alice Chan recently spoke with Men's Journal and TechCrunch about the new second-generation HomePod in wide-ranging interviews about the smart speaker. Apple discontinued the original full-size HomePod in March 2021 after multiple reports indicated that sales of the speaker were lackluster, but Chan told Men's ...
webkit vs chromium feature

Google Working on Browser for iOS That Would Break Apple's App Store Rules

Saturday February 4, 2023 1:30 am PST by
Google's Chromium developers are working on an experimental web browser for iOS that would break Apple's browser engine restrictions, The Register reports. The experimental browser, which is being actively pursued by developers, uses Google's Blink engine. Yet if Google attempted to release it on the App Store, it would not pass Apple's App Review process. Apple's App Store rules dictate...
iOS 16

Apple Preparing iOS 16.3.1 Update for iPhone as Wait for iOS 16.4 Beta Continues

Thursday February 2, 2023 6:41 am PST by
Apple appears to be preparing an iOS 16.3.1 update for the iPhone, based on evidence of the software in our website's analytics logs this week. It's unclear when the update will be released, but it will likely be available at some point in February. The same logs have accurately foreshadowed the release of several previous updates, including iOS 16.0.3 and iOS 16.1.1 most recently, so they...
maxresdefault

Hands-On With Apple's Second-Generation HomePod

Friday February 3, 2023 1:28 pm PST by
Today is the official launch day for the second-generation HomePod that was introduced in January, and we picked one up to compare it to the original HomePod that Apple discontinued in 2021. Subscribe to the MacRumors YouTube channel for more videos. Design wise, the second-generation HomePod looks a lot like the first-generation model, featuring the same rounded design and acoustic mesh...