Apple Watch Proves Most Accurate at Measuring Heart Rate in New Fitness Tracker Study

In a new study comparing the accuracy of seven different fitness trackers, the Apple Watch was found to have the lowest margin of error when measuring heart rate, beating the Basis Peak, Fitbit Surge, Microsoft Band, Mio Alpha 2, PulseOn, and Samsung Gear S2.

Researchers set out to determine the accuracy of wrist-worn devices at measuring both heart rate and energy expenditure, aka calories burned via physical activity. 60 volunteers participated, including 29 males and 31 females, each of whom wore several fitness trackers and completed activities like cycling, running, and walking.

applewatchstudy1
Data gathered by the fitness devices was compared against a "gold standard" tracking method, which included an electrocardiograph (ECG) for measuring heart rate and clinical grade indirect calorimetry (measuring oxygen and carbon dioxide expelled when breathing) for measuring calories burned. An error rate of 5 percent was determined to be within acceptable limits.

Across all of the modes of activity, the Apple Watch had the lowest median heart rate error at 2 percent (1.2% to 2.8%), while the Samsung Gear S2 had the highest error rate at 6.8 percent (4.6% to 9%). The Apple Watch was also notably more accurate at measuring heart rate during the walking test than competing products.

For the walking task, three of the devices achieved a median error rate below 5%: the Apple Watch, 2.5% (1.1%-3.9%); the PulseOn, 4.9% (1.4%-8.6%); and the Microsoft Band, 5.6% (4.9%-6.3%). The remaining four devices had median error between 6.5% and 8.8%.

When it came to measuring calories, no device, Apple Watch included, managed to accurately determine how many calories were burned through activity. Median error rates across all devices and tasks ranged from 27.4 percent (Fitbit Surge) to 92.6 (PulseOn). Though no device was accurate, the Apple Watch did the best at estimating energy expenditure.

applewatchstudy2
Overall, researchers found that most of the fitness trackers tested were able to measure heart rate with an acceptable error level in a laboratory setting, but calorie estimates are largely inaccurate.

There are three principal findings from the current study. In a diverse group of individuals: (1) most wrist-worn monitoring devices report HR with acceptable error under controlled laboratory conditions of walking, running and cycling; (2) no wrist-worn monitoring devices report EE within an acceptable error range under these conditions; (3) of the devices tested, the Apple Watch had the most favorable error profile while the Samsung Gear S2 had the least favorable error profile.

The full study, conducted by Stanford University and the Swedish School of Sport and Health Services, is available in the Journal of Personalized Medicine.

Related Roundup: Apple Watch Series 9
Buyer's Guide: Apple Watch (Caution)

Popular Stories

Apple Vision Pro 2 Feature 2

Apple Reportedly Suspends Work on Vision Pro 2

Tuesday June 18, 2024 8:17 am PDT by
Apple has suspended work on the second-generation Vision Pro headset to singularly focus on a cheaper model, The Information reports. Apple was widely believed to have plans to divide its Vision product line into two models, with one "Pro" model and one lower-cost standard model. The company is said to have been deprioritizing the next Vision Pro headset over the past year, gradually...
Apple WWDC24 Apple Intelligence hero 240610

Apple Explains iPhone 15 Pro Requirement for Apple Intelligence

Wednesday June 19, 2024 4:48 am PDT by
With iOS 18, iPadOS 18, and macOS Sequoia, Apple is introducing a new personalized AI experience called Apple Intelligence that uses on-device, generative large-language models to enhance the user experience across iPhone, iPad, and Mac. These new AI features require Apple's latest iPhone 15 Pro and iPhone 15 Pro Max models to work, while only Macs and iPads with M1 or later chips will...
M4 Real Feature Red

M4 MacBook Pro Models Expected to Launch in Late 2024

Tuesday June 18, 2024 10:50 am PDT by
MacBook Pro models with an M4 chip are expected to launch in the fourth quarter of 2024, according to display analyst Ross Young. In a tweet for subscribers, Young said that panel shipments for new 14-inch and 16-inch MacBook Pro models are set to begin in the third quarter of 2024, which suggests a launch toward the end of the year. Apple started its M4 chip refresh in May with the launch...
2022 back to school apple feature

Apple's 2024 Back to School Sale Launching This Week

Monday June 17, 2024 12:27 pm PDT by
Apple will launch its annual Back to School promotion for university students in the United States and Canada this week, according to Bloomberg's Mark Gurman. Apple's back to school sales provide students with a free Apple gift card when purchasing a Mac or an iPad, and this year's promotion could help Apple push the new M2 iPad Air and M4 iPad Pro models. Last year, Apple offered U.S....
iOS 18 Calendar Feature

iOS 18: Calendar App Design Changes and Reminders Integration

Tuesday June 18, 2024 6:16 am PDT by
Apple in iOS 18 has given the Calendar app a major update, adding some welcome interface design changes, not to mention long-awaited integration with Reminders. In the month-by-month calendar view, the month now appears in large bold font in the top left, while the Events list toggle has been replaced by a new button that lets you choose between Compact, Stacked, Details, and List views. ...
watchOS 11 Thumb 2 1

watchOS 11 Supports Automatic Nap Detection

Monday June 17, 2024 4:05 pm PDT by
watchOS 11 appears to include a new feature that allows an Apple Watch to automatically detect and record when you're taking a nap. As shared on Reddit, an Apple Watch owner took a nap and was able to see the sleep data recorded in the Health app, despite not putting the device in Sleep Mode. Right now, the Apple Watch only tracks and records sleep when it is in Sleep Mode, and there is no...

Top Rated Comments

OldSchoolMacGuy Avatar
92 months ago
Apple puts a lot into R&D and calibration. They know they're the biggest target when it comes to accuracy. Most wouldn't care if FitBit or Samsung aren't overly accurate but you'd see headlines everywhere if Apple were off.

Here's an interesting read on the level technicality they went through to make it incredibly accurate at telling time. It's 4x more accurate than the iPhone actually.

http://mashable.com/2015/12/30/apple-watch-synchronized/#EIku7j18gGq3
Score: 21 Votes (Like | Disagree)
Seoras Avatar
92 months ago
So I read the article. Apple does something better than the competition. Then, just for laughs, I come here to the forum to read the howling and gnashing of teeth from the haters who want to tear them down.
I'm never disappointed, you guys are so entertaining! (& so full of it.) :)
Score: 20 Votes (Like | Disagree)
NightStorm Avatar
92 months ago
Why don't these studies ever compare the Apple Watch with more hardcore fitness watches like those from Garmin or Sunto?
Score: 17 Votes (Like | Disagree)
satchmo Avatar
92 months ago
Why don't these studies ever compare the Apple Watch with more hardcore fitness watches like those from Garmin or Sunto?
Exactly. Garmin is such a giant in the fitness field, that to leave them out seems suspicious.
Score: 13 Votes (Like | Disagree)
jclo Avatar
92 months ago
Why don't these studies ever compare the Apple Watch with more hardcore fitness watches like those from Garmin or Sunto?
I'm not sure why the study didn't include a Garmin product. This was how the trackers were selected:

"Following a comprehensive literature and online search, 45 manufacturers of wrist-worn devices were identified. Criteria for inclusion included: wrist-worn watch or band; continuous measurement of HR; stated battery life >24 h; commercially available direct to consumer at the time of the study; one device per manufacturer. Eight devices met the criteria; Apple Watch; Basis Peak; ePulse2; Fitbit Surge; Microsoft Band; MIO Alpha 2; PulseOn; and Samsung Gear S2."
Score: 11 Votes (Like | Disagree)
ErikGrim Avatar
92 months ago
Why don't these studies ever compare the Apple Watch with more hardcore fitness watches like those from Garmin or Sunto?
Especially galling since they bothered to include the discontinued Microsoft Band.
Score: 9 Votes (Like | Disagree)