Siri on iOS Answered 78.5% of Queries Correctly in Latest Test, Trailing Google Assistant at 85.5% - MacRumors
Skip to Content

Siri on iOS Answered 78.5% of Queries Correctly in Latest Test, Trailing Google Assistant at 85.5%

Five months after performing a test that put the smart speakers of multiple companies in the spotlight to determine how well they performed in various categories, Loup Ventures is back today with an IQ test focused entirely on digital AI assistants. To get the necessary results, the researchers asked Siri, Google Assistant, Alexa, and Cortana 800 questions each on a smartphone, and compared their findings to a previous AI test held in April 2017.

siri iphone x
For Siri in the new test, Apple's AI helper understood 99 percent of the queries and answered 78.5 percent of them correctly. That's an improvement on a similar AI-focused test from April 2017 (66.1 percent of 800 questions answered correctly). While Loup Ventures looked at similar methodologies when testing smart speakers in February, the researchers explain that it's "not worthwhile to compare" the results across these tests since "the use cases differ greatly between digital assistants and smart speakers."

This is particularly true for Siri on HomePod, which performs well in certain areas but is largely limited to the amount of actions it can perform on the speaker itself. This led Apple's HomePod to become relegated to the "bottom of the totem pole" in an AI assistant performance test during Loup Venture's smart speaker research in February, with Siri answering 52.3 percent of 782 total questions correctly, across the same five categories as the new test.

Loup Ventures grades each digital assistant on two metrics: "Did it understand what was being asked?" and "Did it deliver a correct response?" Questions came from five categories, including Local (example: "Where is the nearest coffee shop?"), Commerce ("Can you order me more paper towels?"), Navigations ("How do I get to uptown on the bus?"), Information ("Who do the Twins play tonight?"), and Command ("Remind me to call Steve at 2pm today").

loup ventures july test

Charts via Loup Ventures

Questions were asked of Siri on an iPhone running iOS 11.4, Google Assistant on a Pixel XL, Alexa on the iOS app, and Cortana on the iOS app. Siri's best category was Command (90 percent of questions answered correctly), outperforming all rivals when asked to control aspects of the iPhone, smart home products, Apple Music, and more. Following Command, Siri performed well in Local (87 percent), Navigation (83 percent), and began dipping in Information (70 percent) and Commerce (60 percent).

Google Assistant has the edge in every category except Command. Siri’s lead over the Assistant in this category is odd, given they are both baked into the OS of the phone rather than living on a 3rd party app (as Cortana and Alexa do). We found Siri to be slightly more helpful and versatile (responding to more flexible language) in controlling your phone, smart home, music, etc. Our question set also includes a fair amount of music-related queries (the most common action for smart speakers). Apple, true to its roots, has ensured that Siri is capable with music on both mobile devices and smart speakers.

Google Assistant was the top digital assistant in all categories except Command, with Loup Ventures particularly liking Google's "featured snippets" feature that reads off search results of voice queries and is often "exactly what you're looking for." Both Alexa and Cortana were lesser performers in the test due to the iOS app for each limiting what the assistants can do on an iPhone, unlike Siri's ability to perform tasks all over iOS and not just in one app.

In total, Google Assistant answered 85.5 percent of the 800 questions asked correctly and understood all of them, compared to Siri's 78.5 percent answered correctly and 11 misunderstood. Alexa correctly answered 61.4 percent and misunderstood 13, while Cortana was the "laggard" and correctly answered 52.4 percent and misunderstood 19.

loup ventures july test 2
Over the 15 month period since April 2017, Siri improved by 13 percentage points, with Loup Ventures pointing out that it was "impressed with the speed at which the technology is advancing" for most of the assistants. The researchers went on to explain that many of the issues they had last year were erased by "improvements to natural language processing and inter-device connectivity."

Loup Ventures also sees more improvements coming down the line, particularly for Siri. This fall, the digital assistant will gain new abilities with Apple's upcoming "Siri Shortcuts" feature in iOS 12, which will let users create automations between apps that can be easily triggered through voice commands. The researches say they are "eager to test that feature" when it launches within iOS 12, likely coming in September.

Popular Stories

iOS 27

Apple Releases iOS 27.2 With New Siri AI Languages

Monday October 26, 2026 11:32 am PDT by
Apple today released iOS 27.2 and iPadOS 27.2, the first major updates to the iOS 27 and iPadOS 27 operating systems that came out in September. iOS 27.2 is available for all iPhones able to run iOS 27, including the iPhone Duo, while iPadOS 27.2 is available for all iPads able to run iPadOS 27, including the newly announced OLED iPad mini. The iOS 27.2 update expands Siri AI to new...
Siri AI Icon

iOS 27.3 Beta Adds Daily Siri AI Limits and iCloud+ Upgrades

Monday November 16, 2026 10:14 am PST by
With the latest iOS 27.3, iPadOS 27.3, and macOS 27.3 betas, Apple is starting to test limits and paid upgrades for Siri AI and Apple Intelligence features. Every Apple device gets a free daily access allowance for Siri AI and Apple Intelligence features that rely on server-side AI processing, such as Image Playground and Clean Up in Photos. When that limit is hit, there will be an option to ...
Apple TV 4K 4th Generation feature0

Apple Releases tvOS 27.2.1 With Siri AI for Older Apple TVs

Friday November 13, 2026 11:26 am PST by
Apple today released tvOS 27.2.1, an update to the tvOS 27 operating system that launched in September. tvOS 27.2.1 comes nearly three weeks after Apple released tvOS 27.2. tvOS 27.2.1 brings Siri AI support to the 2nd- and 3rd-generation Apple TV 4K models, but it is available for all Apple TV 4K models that support tvOS 27. Apple announced Siri AI for the Apple TV when debuting the...

Top Rated Comments

DrJohnnyN Avatar
109 months ago
Siriously still bad.
Score: 22 Votes (Like | Disagree)
Heineken Avatar
109 months ago
Impressive number without any personal data mining.
Score: 20 Votes (Like | Disagree)
ikir Avatar
109 months ago
Siriously still bad.
Absolutely not. Sure whiners will always say that.
Siri was and it is great, few years ago was impossible to dream of speak to your device. I use Siri about every hour for work.
Internet forums users tend to bash everything. Siri also is available on many languages and it is a big plus.
Cortana is quite bad for example, want to bash something? Cortana is there.
Score: 18 Votes (Like | Disagree)
MrGimper Avatar
109 months ago
Absolutely not. Sure whiners will always say that.
Siri was and it is great, few years ago was impossible to dream of speak to your device. I use Siri about every hour for work.
Internet forums users tend to bash everything. Siri also is available on many languages and it is a big plus.
Cortana is quite bad for example, want to bash something? Cortana is there.
You know what's more annoying than "whiners?", people who label anyone who has an opinion or criticism that doesn't align with their own, a "whiner".

Glad you use it that much for work, you must have a job where you have to set a lot of timers :cool:
Score: 17 Votes (Like | Disagree)
Stella Avatar
109 months ago
Impressive number without any personal data mining.
Personal Data mining is irrelevant.

Siri still sucks.
Score: 17 Votes (Like | Disagree)
PickUrPoison Avatar
109 months ago
So Siri’s not nearly the train wreck MacRumors forum posters endlessly and loudly claim it to be.

Never could have guessed...

Most improved, usually beaten by google, usually better than Alexa, and always beats Cortana; a lot of folks here aren’t going to want to hear this. Time to shoot the messenger I suppose.
Score: 15 Votes (Like | Disagree)
Latest Stories
Instagram Now Lets You Save Songs to Apple Music
Instagram Now Lets You Save Songs to Apple Music
10 hours ago
Apple Releases Safari Technology Preview 257 With Bug Fixes and Performance Improvements
Apple Releases Safari Technology Preview 257 With Bug Fixes and Performance Improvements
12 hours ago
HomeView 27.2.1 Update Fixes Siri Bugs
HomeView 27.2.1 Update Fixes Siri Bugs
15 hours ago
Apple Card Offers New Users Double Daily Cash for a Year
Apple Card Offers New Users Double Daily Cash for a Year
16 hours ago
Apple Releases 27.2.1 HomeView Software Update
Apple Releases 27.2.1 HomeView Software Update
16 hours ago
Amazon Offering $100 Off Nearly All M4 iPad Air Models
Amazon Offering $100 Off Nearly All M4 iPad Air Models
17 hours ago
Apple's Fall Creator Studio Updates Now Live
Apple's Fall Creator Studio Updates Now Live
18 hours ago
iPhone 20 Pro Rumored to Return to Titanium
iPhone 20 Pro Rumored to Return to Titanium
18 hours ago
Target's Early Black Friday Event Offers Savings on Apple, TVs, and Accessories
Target's Early Black Friday Event Offers Savings on Apple, TVs, and Accessories
20 hours ago
Apple Announces 2026 App Store Award Finalists
Apple Announces 2026 App Store Award Finalists
20 hours ago
iPhone Duo 2 Likely to Retain Touch ID as Face ID Remains Uncertain
iPhone Duo 2 Likely to Retain Touch ID as Face ID Remains Uncertain
21 hours ago
Apple Releases Siri Remote Firmware Update
Apple Releases Siri Remote Firmware Update
21 hours ago
Amazon Takes $850 Off 2026 16-Inch MacBook Pro With M5 Max Chip
Amazon Takes $850 Off 2026 16-Inch MacBook Pro With M5 Max Chip
21 hours ago
WhatsApp's iCloud Backup Alternative Rolls Out to Beta Users on iPhone
WhatsApp's iCloud Backup Alternative Rolls Out to Beta Users on iPhone
22 hours ago
MacPaw's Moonlock Cybersecurity App Launches for iPhone
MacPaw's Moonlock Cybersecurity App Launches for iPhone
22 hours ago
Apple Reportedly Developing Two Designs for 20th Anniversary iPhone
Apple Reportedly Developing Two Designs for 20th Anniversary iPhone
22 hours ago
Apple Rolls Out All-New Maps Experience Across India
Apple Rolls Out All-New Maps Experience Across India
23 hours ago
iPhone Air 2 Reportedly Sticks With Same Display
iPhone Air 2 Reportedly Sticks With Same Display
23 hours ago
iPhone 18 and iPhone Air 2 Display Production to Begin Soon Ahead of Expected March Launch
iPhone 18 and iPhone Air 2 Display Production to Begin Soon Ahead of Expected March Launch
1 day ago
Aqara Debuts Six Matter Smart Lights That Work With Apple Home
Aqara Debuts Six Matter Smart Lights That Work With Apple Home
1 day ago
Disney+ and Hulu Will Fully Merge Into One App in December
Disney+ and Hulu Will Fully Merge Into One App in December
1 day ago
iFixit Says Apple's HomeView is Unnecessarily Hard to Repair
iFixit Says Apple's HomeView is Unnecessarily Hard to Repair
2 days ago
Final Cut Pro Now Includes MotionVFX for Creator Studio Users
Final Cut Pro Now Includes MotionVFX for Creator Studio Users
2 days ago
Apple Blames Internal Update for Outage, Says It Wasn't a Cyberattack
Apple Blames Internal Update for Outage, Says It Wasn't a Cyberattack
2 days ago
Nomad Launches Black Friday Sale With Up to 30% Off Apple Accessories
Nomad Launches Black Friday Sale With Up to 30% Off Apple Accessories
2 days ago
Google Wallet Available on iPhone, But Without Tap to Pay
Google Wallet Available on iPhone, But Without Tap to Pay
2 days ago
Apple Accounts, App Store and Apple Music Experiencing Issues
Apple Accounts, App Store and Apple Music Experiencing Issues
2 days ago
Apple Moves Ahead With Better Dual SIM Support for Apps
Apple Moves Ahead With Better Dual SIM Support for Apps
2 days ago
Former Apple Chairman Plans to Sell $32 Million in Apple Stock
Former Apple Chairman Plans to Sell $32 Million in Apple Stock
2 days ago
Apple Accused of Silencing iPhone Duo Supplier Over 'Crackgate' Issue
Apple Accused of Silencing iPhone Duo Supplier Over 'Crackgate' Issue
2 days ago