Apple Exploring Ways to Run Much Larger AI Models Directly on iPhones - MacRumors
Skip to Content

Apple Exploring Ways to Run Much Larger AI Models Directly on iPhones

Apple has held meetings with PrismML about ways it could use the startup's technology to run much larger AI models directly on iPhones, according to The Information.

ios 27 siri animation
The report said PrismML has managed to shrink down Alibaba's open-source large language model Qwen 3.6 to run entirely on an iPhone 17 Pro. The model has 27 billion parameters, which is larger than Apple's on-device AFM 3 Core Advanced model with 20 billion parameters. Apple's model powers iOS 27 enhancements such as Siri AI's more expressive voices and improved systemwide dictation on iPhone 17 Pro and iPhone Air models.

Unlike with AFM 3 Core Advanced, all of Qwen 3.6's parameters can be active at the same time.

"One new on-device Apple model has 20 billion parameters but uses a so-called sparse architecture, in which only 1 billion to 4 billion parameters are active at a time," the report said, in reference to AFM 3 Core Advanced. "In the case of PrismML's on-device model, all 27 billion parameters are active at the same time."

Larger models running directly on iPhones would allow for more Apple Intelligence features to run on device instead of on Apple's Private Cloud Compute servers, which could reduce Apple's costs and further enhance user privacy.

Popular Stories

iphone 16 teal

Siri Settlement Approved: Apple to Pay Owners of Some iPhone Models

Friday July 24, 2026 8:10 am PDT by
In May, Apple agreed to pay $250 million to settle a U.S. class action lawsuit over Siri AI's delayed launch, and eligible iPhone users could receive up to a $95 payout. Apple's settlement has now received preliminary approval from a judge, according to a July 17 court document. However, there is no settlement website yet, and it may take months before eligible customers can begin submitting ...
apple intelligence black

Apple Briefly Posts China Guide for Connecting Siri to Qwen AI

Monday August 10, 2026 5:21 am PDT by
Apple briefly published a support guide in China explaining how Mac users can connect Alibaba's Qwen AI to Siri and Writing Tools, before pulling it entirely less than a day later. Reuters first spotted the Chinese-language guide on Apple's support site on August 8, which explained how eligible Mac users in mainland China could connect Qwen, Alibaba's family of generative AI models, to Siri...
apple intelligence black

Apple Trained Own AI Model for China Market With Help From Alibaba

Friday August 14, 2026 2:46 am PDT by
Reuters reports that Apple has trained its own large language model for the China market, rather than relying on a third-party model to power its Apple Intelligence features in the country. The LLM has been developed with the help of Alibaba, according to the report's sources. The development marks a break from Apple's previous strategy of relying on domestic models to bring generative AI to ...

Top Rated Comments

Taq'aix Avatar
5 weeks ago
The AI bubble can’t burst soon enough.
Score: 27 Votes (Like | Disagree)
smeagol Avatar
5 weeks ago
Ultimately, Apple shot themselves in the foot by either being stingy with RAM across all devices for decades, or by upgrading to higher capacity memory prohibitively expensive in the name of profits, saying nonsense like 8GB on an Apple device is like 16GB for everyone else. AI came along and told the truth, 8GB is 8GB.
Score: 23 Votes (Like | Disagree)
5 weeks ago


The report said PrismML has managed to shrink down Alibaba's open-source large language model Qwen 3.6 to run entirely on an iPhone 17 Pro. The model has 27 billion parameters,
There are many comments here, and not one about PrismML's new technology.

What they have done is invent a new way to compress a neural network to one bit per parameter. This means each parameter is just a one or a zero. Not only does this save space, it saves a LOT of space. Now Apple's 10B-parameter on-device model will fit in just over 1GB of RAM and hence comfortably into a 6 GB iPhone. (The iPhone 15 has only 6GB of RAM.)

Not only does it save space, but it also runs with less energy because it is very easy to multiply by 1 or by 0. Most of us can do that kind of math in our heads.

How does it work exactly? I don't know yet. I assume it is not so easy as simply normalizing all values to the 0...1 range and thresholding at 0.5. I suspect that replicating the "important" parameters is involved, but I don't know how you would find them.

PrismML says they are not done yet. Of course, a width of 1 is the shortest possible, but maybe they are reducing the number of parameters without doing much harm?

PrismML says the work is based on mathematics. They don't claim AI breakthroughs or better code. This might mean they have some Linear Algebra experts.

Maybe someone here has some better insight?
Score: 20 Votes (Like | Disagree)
DanteHicks79 Avatar
5 weeks ago
👏 NOBODY 👏 WANTS 👏 THIS 👏 AI 👏 GARBAGE 👏
Score: 20 Votes (Like | Disagree)
turbineseaplane Avatar
5 weeks ago

Speak for yourself. If nobody wanted it, it wouldn’t exist.
AI does not exist right now, in its current form, because of demand for it.
Score: 16 Votes (Like | Disagree)
5 weeks ago
This is the future. If we can have current model performance on-device, that will help solve a lot of the energy problems. It's likely years away (if it ever gets there), but it should be one of the goals.
Score: 16 Votes (Like | Disagree)