Report Details Turmoil Behind Apple's AI Efforts, 'Siri X,' and Headset Voice Controls

Siri and Apple's use of AI has been severely held back by caution and organizational dysfunction, according to over three dozen former Apple employees who spoke to The Information's Wayne Ma.

hey siri banner apple
The extensive paywalled report explains why former Apple employees who worked in the company's AI and machine learning groups believe that a lack of ambition and organizational dysfunction have hindered ‌Siri‌ and the company's AI technologies. Apple's virtual assistant is apparently "widely derided" inside the company for its lack of functionality and minimal improvement over time.

By 2018, the team working on ‌Siri‌ had apparently "devolved into a mess, driven by petty turf battles between senior leaders and heated arguments over the direction of the assistant." ‌Siri‌'s leadership did not want to invest in building tools to analyse ‌Siri‌'s usage and engineers lacked the ability to obtain basic details such as how many people were using the virtual assistant and how often they were doing so. The data that was obtained about ‌Siri‌ coming from the data science and engineering team was simply not being used, with some former employees calling it "a waste of time and money."

Many Apple employees purportedly left the company because it was too slow to make decisions or too conservative in its approach to new AI technologies, including the large-language models that underpin chatbots like ChatGPT. Apple CEO Tim Cook personally attempted to persuade engineers who helped Apple modernize its search technology to stay at the company, before they left to work on large-language models at Google.

Apple executives are said to have dismissed proposals to give ‌Siri‌ the ability to conduct extended back-and-forth conversations, claiming that the feature would be difficult to control and gimmicky. Apple's uncompromising stance on privacy has also created challenges for enhancing ‌Siri‌, with the company pushing for more of the virtual assistant's functions to be performed on-device.

Cook and other senior executives requested changes to ‌Siri‌ to prevent embarassing responses and the company prefers ‌Siri‌'s responses to be pre-written by a team of around 20 writers, rather than AI-generated. There were also specific decisions to exclude information such as iPhone prices from ‌Siri‌ to push users directly to Apple's website instead.

‌Siri‌ engineers working on the feature that uses material from the web to answer questions clashed with the design team over how accurate the responses had to be in 2019. The design team demanded a near-perfect accuracy rate before the feature could be released.

Engineers claim to have spent months persuading ‌Siri‌ designers that not every one of its answers needed human verification, a limitation that made it impossible to scale up ‌Siri‌ to answer the huge number of questions asked by users. Similarly, Apple's design team repeatedly rejected the feature that enabled users to report a concern or issue with the content of a ‌Siri‌ answer, preventing machine-learning engineers from understanding mistakes, because it wanted ‌Siri‌ to appear "all-knowing."

In 2019, the ‌Siri‌ team explored a project to rewrite the virtual assistant from scratch, codenamed "Blackbird." The effort sought to create a lightweight version of ‌Siri‌ that would delegate the creation of functions to app developers and would run on iPhones instead of the cloud to improve performance and privacy. Demos of Blackbird apparently prompted excitement among Apple employees owing to its utility and responsiveness.

Blackbird competed with the work of two senior leaders on the ‌Siri‌ team who were responsible for helping ‌Siri‌ understand and respond to queries. These individuals pushed for their own project, codenamed "‌Siri‌ X," for the 10th anniversary of the virtual assistant. The project simply aimed to move ‌Siri‌'s processing on-device for privacy reasons, without the lightweight, modular functionality of Blackbird.

Hundreds of employees working on Blackbird were assigned to ‌Siri‌ X, which killed the ambitious project to make ‌Siri‌ more capable. ‌Siri‌ X was mostly completed in 2021 and now many of the voice assistant's functions are processed locally.

Most recently, the group working on Apple's mixed reality headset were reportedly disappointed by the demonstrations provided by the ‌Siri‌ team on how the virtual assistant could control the headset. At one point in the device's development, the headset team considered building an alternative method for controlling the device using voice commands because ‌Siri‌ was deemed to be unsatisfactory.

Popular Stories

ipad mini 2021 youtube

New Report Reveals When to Expect the iPad Mini 7

Tuesday October 1, 2024 2:09 pm PDT by
Apple is working on a new iPad mini that will "potentially" be released "by the end of 2024," according to a report today from Bloomberg's Mark Gurman. Last month, Gurman reported that Apple had "new iPads in the works," including an upgraded version of the iPad mini. At the time, he said the device was "on deck for Apple's October event" alongside the first M4 Macs. The wording in his...
airpods pro 2 gradient

AirPods Pro 3 Expected Next Year: Here's What We Know

Tuesday October 1, 2024 5:47 am PDT by
Despite being released over two years ago, Apple's AirPods Pro 2 continue to dominate the wireless earbud market. However, with the AirPods Pro 3 expected to launch sometime in 2025, anyone thinking of buying Apple's premium earbuds may be wondering if the next generation is worth holding out for. Apart from their audio and noise-canceling performance, which are generally regarded as...
apple silicon mac lineup wwdc 2022 feature purple

MacBook Pro, iMac, and Redesigned Mac Mini With M4 Chips on Track to Launch 'This Year'

Tuesday October 1, 2024 1:57 pm PDT by
Apple plans to release new MacBook Pro, iMac, and Mac mini models with the M4 series of chips "this year," according to Bloomberg's Mark Gurman. Gurman initially said these Macs would likely be announced during a virtual event this October, but he has been more vague about the timing lately, with wording such as "in the coming weeks" and now merely "this year." In any case, it is clear that...
15 New Things Your iPhone Can Do in iOS 18

15 New Things Your iPhone Can Do in iOS 18.1

Friday September 27, 2024 6:14 am PDT by
Apple is set to release iOS 18.1 in October, bringing the first set of Apple Intelligence features to iPhone 15 Pro and iPhone 16 models. This update marks a significant step forward in Apple's AI integration, offering a new Siri contextually-aware experience and a range of additional capabilities powered by on-device machine learning and large language models. There are a couple of handy new...
iPhone SE 4 Thumb 2

Apple's Next New iPhone to Debut in the Spring: What to Expect

Tuesday October 1, 2024 3:14 am PDT by
Apple's budget-friendly iPhone SE is set for a major overhaul with a fourth generation model expected to launch in spring 2025. The upcoming model will mark a significant departure from its predecessors, adopting several features from higher-end iPhones while maintaining its position as the most affordable new model in Apple's lineup. According to recent reports, the iPhone SE 4 will sport a ...
iPhone SE 4 Thumb 1

iPhone SE With Apple Intelligence, New iPad Air, and More Reportedly Launching 'Early Next Year'

Tuesday October 1, 2024 12:38 pm PDT by
Apple plans to release a new iPhone SE with Apple Intelligence support, new iPad Air models, and an updated Magic Keyboard for the iPad Air at some point "early next year," according to a report today from Bloomberg's Mark Gurman. The next iPhone SE will have a similar design as the iPhone 14, including an edge-to-edge screen with a notch, according to Gurman. This means the device will...
m3 mbp space black

What to Expect From an Apple Event in October: iPad Mini 7, Redesigned Mac Mini, and More

Friday September 27, 2024 11:47 am PDT by
Apple will likely hold another event in October this year to announce new Macs and iPads. If so, it would be the fourth time in the last five years that Apple has held an event in October. Last year, Apple held a virtual event on Monday, October 30 to announce new MacBook Pro and iMac models with the M3 series of chips. Subscribe to the MacRumors YouTube channel for more videos. Below, we...
Generic iOS 18

iOS 18.0.1 Coming Soon: What to Expect for Your iPhone

Wednesday October 2, 2024 5:50 am PDT by
Following the release of iOS 18 for the iPhone last month, Apple is preparing to release iOS 18.0.1 with bug fixes in the near future. We previously reported that Apple has been internally testing iOS 18.0.1, and today a private account on X with a proven track record of sharing iOS-related information said the update will have a build number of 22A3370. We expect iOS 18.0.1 to be a minor ...

Top Rated Comments

Will Co Avatar
19 months ago
The single biggest thing that Apple needs to improve right now. And by a large margin. And a huge level of improvement. And yesterday. In fact, about 5 years ago. Please Apple, it's so embarrassing. And so frustrating. Get on top of this. This is a spectacular failure of leadership.
Score: 120 Votes (Like | Disagree)
orbital~debris Avatar
19 months ago

Tim Cooks
And also runs Apple in his spare time.
Score: 52 Votes (Like | Disagree)
contacos Avatar
19 months ago
In short: Apple bought Siri many years ago, everyone from the initial team has left the company since and Apple has no idea what to do with it (lacking expertise in that area)
Score: 44 Votes (Like | Disagree)
gank41 Avatar
19 months ago
[My experience with Siri in nutshell]

Me: "Hey Siri, play George Harrison's Album All Things Must Pass"
Siri: "Ok, playing songs from a Passed Album of things by people named George"
Score: 38 Votes (Like | Disagree)
icanhazmac Avatar
19 months ago

The company's uncompromising stance on privacy has also proven challenging for enhancing Siri, with Apple pushing for more of the virtual assistant's functions to be performed on-device.
I'll accept Siri having limited capabilities versus all of my requests being sent to a "mothership" for processing, collection and sale.

Alexa may be more functional but I don't trust it (Amazon) at all from a privacy standpoint.
Score: 38 Votes (Like | Disagree)
thebeans Avatar
19 months ago

To her defense I must say that speech-to-text (at least in Swedish) works great. She’s not that helpful otherwise except for setting timers and other mundane tasks.
And speaking of setting timers, why is it the $30 Alexa in my kitchen can set multiple timers and my $1000 iPhone 14 Pro can only set one?
Score: 38 Votes (Like | Disagree)