Netflix to Replace Star Ratings With Thumbs Up and Thumbs Down

by

Netflix announced yesterday that it will replace star-based user reviews in its content library with binary thumbs up and thumbs down ratings over the coming weeks.

Previous star ratings given by users will be used to personalize their Netflix profiles, but the ability to rate a TV series or movie by awarding stars is set to disappear altogether, according to Variety.

img 20170316 143235

Image via Variety

Netflix VP of Product Todd Yellin told journalists on Thursday during a press briefing at the company’s headquarters in Los Gatos, Calif., that the company had tested the new thumbs up and down ratings with hundred of thousands of members in 2016. "We are addicted to the methodology of A/B testing," Yellin said. The result was that thumbs got 200% more ratings than the traditional star-rating feature.

According to Netflix, at one point subscribers had awarded over 10 billion 5-star ratings and more than half of all members had rated more than 50 titles. However, the company eventually concluded that star ratings had become less relevant, with some users giving documentaries 5 stars and silly movies just 3 stars, even though they would watch the silly movies more often than the highly rated documentaries.

"We made ratings less important because the implicit signal of your behavior is more important," Yellin told journalists.

In addition to the binary rating scheme, Netflix is also bringing a new percent-match feature to its interface that shows how good a match any given show or movie is for an individual subscriber. If a movie or TV show fits very closely with a user's taste, it may get a high percentage match, although shows with less than a 50 percent match won't show a match rating.

Netflix said the changes will roll out globally within the next month or so.

Tag: Netflix

Top Rated Comments

adamneer Avatar
48 months ago
Great, another avenue for displaying what's most popular, rather than what's best. That's the key reason a ****** comedy would be viewed more than an award winning documentary and yet receive less stars. It's really not that hard to figure out.
Score: 9 Votes (Like | Disagree)
smacrumon Avatar
48 months ago
Thanks for rating Netflix, Smacrumon!


[doublepost=1489748283][/doublepost]

Makes sense. Most people don't bother to think about what star rating a piece of content really deserves anyway. I only ever check star ratings on rotten tomatoes, where you get insightful write-ups too.

Most people actually do know how to offer an opinion on a scale of 1-5, 1 being very poor, 5 being very great. People know exactly how to use star ratings. Star ratings are nuanced whether or not it is accompanied with write ups.
Score: 7 Votes (Like | Disagree)
gixxerfool Avatar
48 months ago

good, i dont think anyone fully understood those star rating anyway. It took me years to realize that those star ratings are based on what you watched before / your taste and not the overall rating from the whole user base

Well, that clears up a lot of questions I've had over the years. Thank you for that.
Score: 6 Votes (Like | Disagree)
itsmilo Avatar
48 months ago
good, i dont think anyone fully understood those star rating anyway. It took me years to realize that those star ratings are based on what you watched before / your taste and not the overall rating from the whole user base
Score: 4 Votes (Like | Disagree)
Three141 Avatar
48 months ago
I got to use this quote.

"We made ratings less important because the implicit signal of your behavior is more important," Yellin told journalists."
Score: 3 Votes (Like | Disagree)
thisisnotmyname Avatar
48 months ago
And yet my recommended for you category continues to have many one and one and a half star movies. If you've determined it would be one star for me why are you recommending it to me?
Score: 3 Votes (Like | Disagree)

Top Stories

m1 chip macbook air pro

Kuo: Redesigned MacBooks With Apple Silicon to Launch in Second Half of 2021

Tuesday November 24, 2020 7:53 pm PST by
Apple plans to release additional MacBook models with Apple Silicon in the second half of 2021, according to analyst Ming-Chi Kuo, as part of the company's two-year transition away from Intel processors across its Mac lineup. In a research note today, obtained by MacRumors, Kuo said that these MacBook models will feature a new design. Kuo did not specify which models these will be, but he...
Apple Watc black friday 20 sale feature

Apple Black Friday 2020: Best Apple Watch Deals [Updated]

Wednesday November 25, 2020 4:01 pm PST by
Black Friday sales have begun on a variety of products, including the Apple Watch. There are quite a few deals across the Apple Watch lineup this year, including one of the lowest price we've ever seen the Apple Watch Series 3. Note: MacRumors is an affiliate partner with some of these vendors. When you click a link and make a purchase, we may receive a small payment, which helps us keep the...
AirPods Pro black friday 20 sale feature 2

Black Friday 2020: AirPods Pro Reach Lowest Price Ever [Updated]

Wednesday November 25, 2020 3:22 pm PST by
Black Friday has kicked off this week, and one of the first major sales for the AirPods Pro is available right now on Walmart. You can find this deal below, along with a few other solid discounts on the regular AirPods. Note: MacRumors is an affiliate partner with some of these vendors. When you click a link and make a purchase, we may receive a small payment, which helps us keep the site...
13 16 inch macbook pro air trio

Reliable Leaker Suggests Redesigned MacBooks in 2021 Will Include Both Apple Silicon and Intel Models

Wednesday November 25, 2020 9:15 am PST by
Reliable leaker known as "L0vetodream" has today suggested on Twitter that redesigned MacBooks coming in the second half of 2021 will include models with both Apple Silicon chips and Intel processors. The brief Tweet came in response to a MacRumors article from earlier today, which outlined a report from Ming-Chi Kuo claiming that Apple plans to release redesigned MacBook models with Apple ...
mac mini macbook pro macbook air

Apple M1 Hands-On Comparison: MacBook Air vs. MacBook Pro vs. Mac Mini

Monday November 23, 2020 3:40 pm PST by
Apple's M1 Macs are out in the wild now, but ahead of the holidays, you might still be trying to figure out which one to pick up, either for yourself or as a gift for someone else. We've got all three of the new Macs available, so we thought we'd give MacRumors readers a hands-on overview of each machine in our latest YouTube video. Subscribe to the MacRumors YouTube channel for more videos. ...
app store christmas icon

Apple Shutting Down App Store Connect From December 23 to December 27

Monday November 23, 2020 10:14 am PST by
Apple shuts down App Store Connect for a week around the holidays each year in an effort to give App Store staff time off from work. This year, App Store Connect will be unavailable from December 23 to December 27. With App Store Connect unavailable, Apple will not accept new apps or app updates, so all pricing changes and new app submissions need to be locked in before those dates for...
iPads black friday 20 sale feature

Apple Black Friday 2020: Best iPad Deals

Tuesday November 24, 2020 8:51 am PST by
Although we're still a few days away from the official launch of Black Friday, we've known for a few weeks that many retailers would be kicking off discounts ahead of November 27. Because of this trend, today we're tracking discounts across Apple's lineup of iPads, including the 10.2-inch iPad and 2020 iPad Pro. More sales are likely to appear as the week progresses, and when they do we'll update ...
Target November Deals 1

Black Friday Spotlight: Target Begins Week-Long Sale With Deals on iPhone 12, Powerbeats Pro, and More

Monday November 23, 2020 8:07 am PST by
We've been tracking early Black Friday deals in our dedicated Black Friday Roundup, and in an effort to prepare our readers for the big shopping event we're highlighting sales store-by-store in the lead-up to November 27. Note: MacRumors is an affiliate partner with Target. When you click a link and make a purchase, we may receive a small payment, which helps us keep the site running....
new mac mini logicpro screen

M1 Macs Able to Run Up to Six External Displays Using DisplayLink

Tuesday November 24, 2020 6:53 am PST by
It is possible to run up to six external displays from the M1 Mac mini, and five external displays from the M1 MacBook Air and MacBook Pro, with the aid of DisplayPort adapters, according to YouTuber Ruslan Tulupov. This far exceeds Apple's specified limits on external displays with the M1 Macs. Apple's host of new M1 Macs are not capable of supporting as many external displays as their...
2020 apple shopping event

Apple Offering Up to $150 Gift Card With Select Products on Black Friday Through Cyber Monday

Monday November 23, 2020 2:53 am PST by
Apple has announced its annual four-day shopping event, offering customers up to a $150 Apple Store gift card with the purchase of select products between Black Friday and Cyber Monday in the United States. The gift card values in the United States are as follows: $150 for 16-inch MacBook Pro $150 for 21.5-inch iMac $50 for 13-inch MacBook Pro $50 for MacBook Air $50 for iPhone SE,...