Apple Watch Proves Most Accurate at Measuring Heart Rate in New Fitness Tracker Study

In a new study comparing the accuracy of seven different fitness trackers, the Apple Watch was found to have the lowest margin of error when measuring heart rate, beating the Basis Peak, Fitbit Surge, Microsoft Band, Mio Alpha 2, PulseOn, and Samsung Gear S2.

Researchers set out to determine the accuracy of wrist-worn devices at measuring both heart rate and energy expenditure, aka calories burned via physical activity. 60 volunteers participated, including 29 males and 31 females, each of whom wore several fitness trackers and completed activities like cycling, running, and walking.

applewatchstudy1
Data gathered by the fitness devices was compared against a "gold standard" tracking method, which included an electrocardiograph (ECG) for measuring heart rate and clinical grade indirect calorimetry (measuring oxygen and carbon dioxide expelled when breathing) for measuring calories burned. An error rate of 5 percent was determined to be within acceptable limits.

Across all of the modes of activity, the Apple Watch had the lowest median heart rate error at 2 percent (1.2% to 2.8%), while the Samsung Gear S2 had the highest error rate at 6.8 percent (4.6% to 9%). The Apple Watch was also notably more accurate at measuring heart rate during the walking test than competing products.

For the walking task, three of the devices achieved a median error rate below 5%: the Apple Watch, 2.5% (1.1%-3.9%); the PulseOn, 4.9% (1.4%-8.6%); and the Microsoft Band, 5.6% (4.9%-6.3%). The remaining four devices had median error between 6.5% and 8.8%.

When it came to measuring calories, no device, Apple Watch included, managed to accurately determine how many calories were burned through activity. Median error rates across all devices and tasks ranged from 27.4 percent (Fitbit Surge) to 92.6 (PulseOn). Though no device was accurate, the Apple Watch did the best at estimating energy expenditure.

applewatchstudy2
Overall, researchers found that most of the fitness trackers tested were able to measure heart rate with an acceptable error level in a laboratory setting, but calorie estimates are largely inaccurate.

There are three principal findings from the current study. In a diverse group of individuals: (1) most wrist-worn monitoring devices report HR with acceptable error under controlled laboratory conditions of walking, running and cycling; (2) no wrist-worn monitoring devices report EE within an acceptable error range under these conditions; (3) of the devices tested, the Apple Watch had the most favorable error profile while the Samsung Gear S2 had the least favorable error profile.

The full study, conducted by Stanford University and the Swedish School of Sport and Health Services, is available in the Journal of Personalized Medicine.

Related Roundup: Apple Watch Series 9
Buyer's Guide: Apple Watch (Neutral)

Top Rated Comments

OldSchoolMacGuy Avatar
89 months ago
Apple puts a lot into R&D and calibration. They know they're the biggest target when it comes to accuracy. Most wouldn't care if FitBit or Samsung aren't overly accurate but you'd see headlines everywhere if Apple were off.

Here's an interesting read on the level technicality they went through to make it incredibly accurate at telling time. It's 4x more accurate than the iPhone actually.

http://mashable.com/2015/12/30/apple-watch-synchronized/#EIku7j18gGq3
Score: 21 Votes (Like | Disagree)
Seoras Avatar
89 months ago
So I read the article. Apple does something better than the competition. Then, just for laughs, I come here to the forum to read the howling and gnashing of teeth from the haters who want to tear them down.
I'm never disappointed, you guys are so entertaining! (& so full of it.) :)
Score: 20 Votes (Like | Disagree)
NightStorm Avatar
89 months ago
Why don't these studies ever compare the Apple Watch with more hardcore fitness watches like those from Garmin or Sunto?
Score: 17 Votes (Like | Disagree)
satchmo Avatar
89 months ago
Why don't these studies ever compare the Apple Watch with more hardcore fitness watches like those from Garmin or Sunto?
Exactly. Garmin is such a giant in the fitness field, that to leave them out seems suspicious.
Score: 13 Votes (Like | Disagree)
jclo Avatar
89 months ago
Why don't these studies ever compare the Apple Watch with more hardcore fitness watches like those from Garmin or Sunto?
I'm not sure why the study didn't include a Garmin product. This was how the trackers were selected:

"Following a comprehensive literature and online search, 45 manufacturers of wrist-worn devices were identified. Criteria for inclusion included: wrist-worn watch or band; continuous measurement of HR; stated battery life >24 h; commercially available direct to consumer at the time of the study; one device per manufacturer. Eight devices met the criteria; Apple Watch; Basis Peak; ePulse2; Fitbit Surge; Microsoft Band; MIO Alpha 2; PulseOn; and Samsung Gear S2."
Score: 11 Votes (Like | Disagree)
ErikGrim Avatar
89 months ago
Why don't these studies ever compare the Apple Watch with more hardcore fitness watches like those from Garmin or Sunto?
Especially galling since they bothered to include the discontinued Microsoft Band.
Score: 9 Votes (Like | Disagree)

Popular Stories

iPhone 16 Camera Lozenge 2 Perspective Gray

Five Key Upgrades Coming to iPhone 16

Friday March 15, 2024 1:45 pm PDT by
The iPhone is Apple's top-selling product, and it gets an update every year. In 2024, we're expecting the iPhone 16 and iPhone 16 Pro lineup, with an arguably more interesting feature set than we got with the iPhone 15 and iPhone 15 Pro. Subscribe to the MacRumors YouTube channel for more videos. Capture Button All four iPhone 16 models are set to get a whole new button, which will be...
iphone se 4 modified flag edges

iPhone SE 4 Expected to Depreciate Heavily

Tuesday March 12, 2024 9:04 am PDT by
Resale value trends suggest the iPhone SE 4 may not hold its value as well as Apple's flagship models, according to SellCell. According to the report, Apple's iPhone SE models have historically depreciated much more rapidly than the company's more premium offerings. The third-generation iPhone SE, which launched in March 2022, experienced a significant drop in resale value, losing 42.6%...
apple wallet drivers license feature

Apple Said iPhone Driver's Licenses Would Expand to These 8 U.S. States… Two Years Ago

Thursday March 14, 2024 7:33 am PDT by
In just four U.S. states, residents can add their driver's license or ID to the Apple Wallet app on the iPhone and Apple Watch, providing a convenient and contactless way to display proof of identity or age at select airports, businesses, and venues. Adoption of the feature has been slow since Apple first announced it in September 2021, with IDs in the Wallet app only available in Arizona,...
airpods 3 orange

Two New AirPods 4 Models Expected to Launch in September or October

Sunday March 17, 2024 7:56 am PDT by
Apple suppliers will begin production of two new fourth-generation AirPods models in May, according to Bloomberg's Mark Gurman. Based on this production timeframe, he expects the headphones to be released in September or October. Gurman expects both fourth-generation AirPods models to feature a new design with better fit, improved sound quality, and an updated charging case with a USB-C...
OLED iPad Air

iPad Air Next on Apple's OLED Tablet Roadmap Following iPad Pro

Friday March 15, 2024 3:30 am PDT by
The iPad Air will be the next Apple tablet to adopt OLED display panel technology following its upcoming OLED iPad Pro models, according to an updated forecast from research firm Omdia (via The Elec). "In 2028, we expect the iPad Air to go OLED as well, with the iPad Air using single-stack and the iPad Pro using two-stack tandem OLEDs," said Omdia researcher Kang Min-soo, speaking on...
Walmart MacBook Air M1

Walmart Begins Selling MacBook Air With M1 Chip for $699 in U.S.

Friday March 15, 2024 6:57 am PDT by
Walmart today announced that it has started selling the MacBook Air with the M1 chip in the U.S., with pricing set at a very reasonable $699. The laptop can be ordered now on Walmart.com, and it will be available soon at select Walmart stores. This is the first time that customers can purchase a Mac that is sold directly by Walmart, the company said in a press release. Some other retailers...
AirPods Pro Case With Screen

AirPods Case With Touchscreen Knock-Off Copies Apple Patent

Thursday March 14, 2024 4:29 am PDT by
Apple registers many patents most of which never see the light of day as consumer products – officially, that is. One burgeoning knock-off merchant in China has apparently taken cues from an idea Apple had in 2021 for AirPods featuring a case with a built-in touchscreen display. Pictures and video shared on X (Twitter) by occasional leaker @lipilipsi show production units of counterfeit...