If you're new to AirPods, considering buying a pair, or just want to pick up some new tips.
Siri's Accuracy Continues to Improve as Apple Works to Reduce Reliance on Google
Piper Jaffray analyst Gene Munster, who has regularly assessed Siri's accuracy in terms of correctly interpreting and answering queries, has issued the latest version of his Siri report card, noting that Siri has continued to improve under iOS 7, particularly in terms of being able to properly interpret questions being asked.
The improvements in Siri's understanding come alongside but separate from Apple's continued efforts to reduce its reliance on Google, as evidenced by Siri's shift to emphasize Bing, Wikipedia, and WolframAlpha results. In Munster's most recent testing, only 4 percent of Siri's answers relied on Google, compared to 17 percent in August testing and 27 percent in December 2012.
Click for larger
Munster also compares Siri to Google Now, finding that the two services are now essentially tied in effectiveness with a "C+" score after Siri held a substantial lead in the year-ago testing. In the latest testing, Google Now held small leads in content areas such as commerce and information, while Siri performed significantly better for operating system controls.
The primary improvement between Siri in iOS 6 and iOS 7 came from its performance in noisier areas, where Siri was able to translate better through a noisy environment (94% vs. 83% correct in Aug iOS 6). Based on our testing, iOS 7 Siri's net ability to answer questions (factors in questions not correctly understood) improved to 79% from 77% in August with iOS 6.
The improvements in Siri's understanding come alongside but separate from Apple's continued efforts to reduce its reliance on Google, as evidenced by Siri's shift to emphasize Bing, Wikipedia, and WolframAlpha results. In Munster's most recent testing, only 4 percent of Siri's answers relied on Google, compared to 17 percent in August testing and 27 percent in December 2012.
Munster also compares Siri to Google Now, finding that the two services are now essentially tied in effectiveness with a "C+" score after Siri held a substantial lead in the year-ago testing. In the latest testing, Google Now held small leads in content areas such as commerce and information, while Siri performed significantly better for operating system controls.
[ 112 comments ]
Top Rated Comments
(View all)
68 months ago
There is no way these charts are accurate. Even when I speak as clearly as possible and enunciate every syllable, Siri understands me about 40% of the time.
I get 90% accuracy, I don't know what's going on with you.
68 months ago
So even though its accuracy at understanding has gone up, the accuracy of its answers has actually got worse?
68 months ago
There is no way these charts are accurate. Even when I speak as clearly as possible and enunciate every syllable, Siri understands me about 40% of the time.
68 months ago
The one thing I will greatly defend Apple and Siri for is trying to understand people's voices. People either have a strong accent, speak with a lisp, speak too fast, speak too slow, speak with a low register voice, have an annoying voice, mumble their words, garble their words and most of all they try and use Siri in a noisy atmosphere along with any of the above.
No matter what, it's still an electronic device and people just have to learn to speak properly based on the source or just don't use as you've appeared to do. You say you have no need for voice control, it's not just about voice control. Many times I need to look up sports scores, it's much faster and easier just to ask Siri the game stats than typing them in or opening an app and searching.
Never defend a technology! Technology is meant to develop to serve the requirements/limitations of existing human behaviour; human behaviour shouldn't be expected to adapt to meet the requirements/limitations of technology.
68 months ago
I have had the opposite experience. After seeing steady improvement in Siri, it has recently gotten worse and become almost unusable for me.
Specifically, I use Siri a lot to play music in the car. I will say "Play Song X" or "Play Album Y". Siri used to be pretty good at hearing the name of the song and finding it in my music library. Now it frequently hear the names incorrectly. Even when it does hear the correct name, it will play a song with a completely different name or simply say "Sorry, I couldn't find that in your music". What do you mean you couldn't find David Bowie in my music??? It's right there!
This regression is quite infuriating. Also, Siri still often fails to respond ("Sorry, there's something wrong") or take 20+ seconds to respond with the wrong answer. I believe we need to give all of Apple's web services time to gather data and make iterative improvements, but I have very little tolerance when they actually get worse over time.
Specifically, I use Siri a lot to play music in the car. I will say "Play Song X" or "Play Album Y". Siri used to be pretty good at hearing the name of the song and finding it in my music library. Now it frequently hear the names incorrectly. Even when it does hear the correct name, it will play a song with a completely different name or simply say "Sorry, I couldn't find that in your music". What do you mean you couldn't find David Bowie in my music??? It's right there!
This regression is quite infuriating. Also, Siri still often fails to respond ("Sorry, there's something wrong") or take 20+ seconds to respond with the wrong answer. I believe we need to give all of Apple's web services time to gather data and make iterative improvements, but I have very little tolerance when they actually get worse over time.
68 months ago
I don't know, that net percentage increase (4% better) year over year seems kind of low to me. Am I the only one who feels that way? Not my field of study, so I'm not entirely sure if this is supposed to be impressive.
68 months ago
Google search works nearly 100% of the time for me on my iPhone 4. Siri 0% hahaha....oh wait, apple says my phone can't handle voice search. tsk tsk apple.
68 months ago
There is no way these charts are accurate. Even when I speak as clearly as possible and enunciate every syllable, Siri understands me about 40% of the time.
Barry Kripke, is that you? :D
----------
I get 90% accuracy, I don't know what's going on with you.
I agree. I get close to 90% and I'm from overseas :D
68 months ago
Siri, the least used 'feature' on my iPhone. Maybe someday I'll take the time to really understand how to make it work for me, but in the meantime, I'd rather type something into Google, or Yelp, or Maps, or....
68 months ago
Until Apple adds on-device voice parsing (like Google does) and rely less on server based transcription, Siri will never be as good and fast as Google Now.
Offline parsing is rarely done on Android. It is there as a backup. What makes Google fast is it is able to translate it in real time and not have to wait for you to finish. You can see this happening live as it tends to guess what you say but when you are done it will go back and correct some words based on the totality of what you said.
[ Read All Comments ]
For this week's giveaway, we've teamed up with Tap to give MacRumors readers a chance to win one of the company's wearable keyboard setups, which Tap believes will be the keyboard of the...
Eve (formerly known as Elgato) was one of the first companies to come out with HomeKit accessories when HomeKit was announced in 2014, and since then, Eve has been expanding its portfolio of...
There are a few notable flash sales going on today, including a discount on a refurbished model of Apple's HomePod smart speaker. The speaker is on sale for $234.99, $115 off from its...
Apple is teaming up with Chinese payments company Ant Financial Services Group, along with several local banks, to offer local customers interest-free financing on iPhones in China (via Reuters)....
OWC this week announced a neat and tidy solution for quickly disconnecting multiple drives from any OWC dock, with the release of a free Dock Ejector utility.
The Mac app lives silently in...
Well-known cable and accessory maker Monoprice today introduced a new sale on Thunderbolt cables, with discounts reaching as much as 35 percent off of original prices during the limited-time event....
Parallels this week debuted a new promo bundle for both new and current users, offering a chance to buy or upgrade to Parallels Desktop 14, and then get ten other Mac apps for free. New owners can...
Over the past few weeks, a handful of users have reported receiving the message "an error occurred" when attempting to load the "For You" tab in iTunes, which provides personalized...
