Apple Develops Breakthrough Method for Running LLMs on iPhones - MacRumors
Skip to Content

Apple Develops Breakthrough Method for Running LLMs on iPhones

Apple GPT in your pocket? It could be a reality sooner than you think. Apple AI researchers say they have made a key breakthrough in deploying large language models (LLMs) on iPhones and other Apple devices with limited memory by inventing an innovative flash memory utilization technique.

siri symbol iphone

LLMs and Memory Constraints

LLM-based chatbots like ChatGPT and Claude are incredibly data and memory-intensive, typically requiring vast amounts of memory to function, which is a challenge for devices like iPhones that have limited memory capacity. To tackle this issue, Apple researchers have developed a novel technique that uses flash memory – the same memory where your apps and photos live – to store the AI model's data.

Storing AI on Flash Memory

In a new research paper titled "LLM in a flash: Efficient Large Language Model Inference with Limited Memory," the authors note that flash storage is more abundant in mobile devices than the RAM traditionally used for running LLMs. Their method cleverly bypasses the limitation using two key techniques that minimize data transfer and maximize flash memory throughput:

  1. Windowing: Think of this as a recycling method. Instead of loading new data every time, the AI model reuses some of the data it already processed. This reduces the need for constant memory fetching, making the process faster and smoother.
  2. Row-Column Bundling: This technique is like reading a book in larger chunks instead of one word at a time. By grouping data more efficiently, it can be read faster from the flash memory, speeding up the AI's ability to understand and generate language.

The combination of these methods allows AI models to run up to twice the size of the iPhone's available memory, according to the paper. This translates to a 4-5 times increase in speed on standard processors (CPUs) and an impressive 20-25 times faster on graphics processors (GPUs). "This breakthrough is particularly crucial for deploying advanced LLMs in resource-limited environments, thereby expanding their applicability and accessibility," write the authors.

Faster AI on iPhone

The breakthrough in AI efficiency opens new possibilities for future iPhones, such as more advanced Siri capabilities, real-time language translation, and sophisticated AI-driven features in photography and augmented reality. The technology also sets the stage for iPhones to run complex AI assistants and chatbots on-device, something Apple is already said to be working on.

Apple's work on generative AI could eventually be incorporated into its ‌Siri‌ voice assistant. Apple in February 2023 held an AI summit and briefed employees on its large language model work. According to Bloomberg, Apple is aiming for a smarter version of Siri that's deeply integrated with AI. Apple is planning to update the way that ‌Siri‌ interacts with the Messages app, allowing users to field complex questions and auto-complete sentences more effectively. Beyond that, Apple is rumored to be planning to add AI to as many Apple apps as possible.

Apple GPT

Apple is reportedly developing its own generative AI model called "Ajax". Designed to rival the likes of OpenAI's GPT-3 and GPT-4, Ajax operates on 200 billion parameters, suggesting a high level of complexity and capability in language understanding and generation. Internally known as "Apple GPT," Ajax aims to unify machine learning development across Apple, suggesting a broader strategy to integrate AI more deeply into Apple's ecosystem.

As of the latest reports, Ajax is considered more capable than the earlier generation ChatGPT 3.5. However, it's also suggested that OpenAI's newer models may have advanced beyond Ajax's capabilities as of September 2023​.

Both The Information and analyst Jeff Pu claim that Apple will have some kind of generative AI feature available on the ‌iPhone‌ and iPad around late 2024, which is when iOS 18 will be coming out. Pu said in October that Apple is building a few hundred AI servers in 2023, with more to come in 2024. Apple will reportedly offer a combination of cloud-based AI and AI with on-device processing.

Popular Stories

Apple Health AI Study App Feature

Apple Just Released a New App

Monday November 16, 2026 9:43 am PST by
Apple today launched a new research study in the U.S. to explore the use of AI for health, and it has released a dedicated iPhone app for participants. In a press release, Apple said the study and app are "designed to advance the understanding of how people interact with conversational health AI tools." The Apple Health AI Study App contains a generative AI chatbot that participants can...
iphone duo yellow hand

Apple Adds Facial Unlock Option on iPhone Duo in iOS 27.3

Monday November 16, 2026 10:17 am PST by
Apple today added a new option for unlocking the iPhone Duo using the front-facing camera, giving device users multiple ways to access their content. The feature is available in the second iOS 27.3 beta. The option to unlock with facial recognition is only available on the Lock Screen, and authentication via Touch ID is still needed for Apple Pay purchases, adding passwords and logins, and...
bug security vulnerability issue fix larry

iPhone Users Targeted in Major Website Security Breach

Tuesday November 17, 2026 4:41 am PST by
Hackers used some of the world's most popular websites to distribute malware designed to steal cryptocurrency and exploit vulnerabilities in iPhones and iPads this week, according to a new security investigation. Reuters reports that websites associated with 178 organizations were affected by the attack on Monday, November 16, including the likes of Zoom, BBC, CNN, HSBC, Salesforce, and...

Top Rated Comments

38 months ago
“Siri, when’s Apple GPT going to be released?”

“Here are the neatest pizza restaurants. Would you like directions?”
Score: 66 Votes (Like | Disagree)
38 months ago
Apple is so clever to avoid adding more ram 😉
Score: 54 Votes (Like | Disagree)
Abazigal Avatar
38 months ago

Does this mean Siri will finally be able to “call my wife on iPhone” again after losing that ability around 2-3 years ago?
At least it didn't respond with "which one?" 😉
Score: 34 Votes (Like | Disagree)
38 months ago
LOL innovative invention of swapping memory to storage…… maybe they can call it something cool like “cache”.
Score: 23 Votes (Like | Disagree)
38 months ago
Sounds like some significant headway. I’d definitely like as much AI done on device as possible.

Apple will probably always be behind with their LLM as long as they prioritize privacy, which I’m very ok with. But just like with big phones, they will bend if there is enough market pressure, which I suspect may eventually be the case.
Score: 21 Votes (Like | Disagree)
contacos Avatar
38 months ago
I'll be impressed when Siri is finally multi-lingual. I cannot believe Siri was released with iPhone 4S and it still cannot do it. It could be as simple as being "aware" what language you usually type in with contact A and automatically use Siri in language X to communicate with this person while using language Y with contact Y. All they did was "this text is in another language, do you still want me to read " with iOS 16
Score: 18 Votes (Like | Disagree)
Latest Stories
Instagram Now Lets You Save Songs to Apple Music
Instagram Now Lets You Save Songs to Apple Music
6 hours ago
Apple Releases Safari Technology Preview 257 With Bug Fixes and Performance Improvements
Apple Releases Safari Technology Preview 257 With Bug Fixes and Performance Improvements
8 hours ago
HomeView 27.2.1 Update Fixes Siri Bugs
HomeView 27.2.1 Update Fixes Siri Bugs
11 hours ago
Apple Card Offers New Users Double Daily Cash for a Year
Apple Card Offers New Users Double Daily Cash for a Year
12 hours ago
Apple Releases 27.2.1 HomeView Software Update
Apple Releases 27.2.1 HomeView Software Update
13 hours ago
Amazon Offering $100 Off Nearly All M4 iPad Air Models
Amazon Offering $100 Off Nearly All M4 iPad Air Models
14 hours ago
Apple's Fall Creator Studio Updates Now Live
Apple's Fall Creator Studio Updates Now Live
14 hours ago
iPhone 20 Pro Rumored to Return to Titanium
iPhone 20 Pro Rumored to Return to Titanium
14 hours ago
Target's Early Black Friday Event Offers Savings on Apple, TVs, and Accessories
Target's Early Black Friday Event Offers Savings on Apple, TVs, and Accessories
16 hours ago
Apple Announces 2026 App Store Award Finalists
Apple Announces 2026 App Store Award Finalists
17 hours ago
iPhone Duo 2 Likely to Retain Touch ID as Face ID Remains Uncertain
iPhone Duo 2 Likely to Retain Touch ID as Face ID Remains Uncertain
17 hours ago
Apple Releases Siri Remote Firmware Update
Apple Releases Siri Remote Firmware Update
17 hours ago
Amazon Takes $850 Off 2026 16-Inch MacBook Pro With M5 Max Chip
Amazon Takes $850 Off 2026 16-Inch MacBook Pro With M5 Max Chip
18 hours ago
WhatsApp's iCloud Backup Alternative Rolls Out to Beta Users on iPhone
WhatsApp's iCloud Backup Alternative Rolls Out to Beta Users on iPhone
18 hours ago
MacPaw's Moonlock Cybersecurity App Launches for iPhone
MacPaw's Moonlock Cybersecurity App Launches for iPhone
18 hours ago
Apple Reportedly Developing Two Designs for 20th Anniversary iPhone
Apple Reportedly Developing Two Designs for 20th Anniversary iPhone
19 hours ago
Apple Rolls Out All-New Maps Experience Across India
Apple Rolls Out All-New Maps Experience Across India
19 hours ago
iPhone Air 2 Reportedly Sticks With Same Display
iPhone Air 2 Reportedly Sticks With Same Display
20 hours ago
iPhone 18 and iPhone Air 2 Display Production to Begin Soon Ahead of Expected March Launch
iPhone 18 and iPhone Air 2 Display Production to Begin Soon Ahead of Expected March Launch
20 hours ago
Aqara Debuts Six Matter Smart Lights That Work With Apple Home
Aqara Debuts Six Matter Smart Lights That Work With Apple Home
1 day ago
Disney+ and Hulu Will Fully Merge Into One App in December
Disney+ and Hulu Will Fully Merge Into One App in December
1 day ago
iFixit Says Apple's HomeView is Unnecessarily Hard to Repair
iFixit Says Apple's HomeView is Unnecessarily Hard to Repair
1 day ago
Final Cut Pro Now Includes MotionVFX for Creator Studio Users
Final Cut Pro Now Includes MotionVFX for Creator Studio Users
1 day ago
Apple Blames Internal Update for Outage, Says It Wasn't a Cyberattack
Apple Blames Internal Update for Outage, Says It Wasn't a Cyberattack
2 days ago
Nomad Launches Black Friday Sale With Up to 30% Off Apple Accessories
Nomad Launches Black Friday Sale With Up to 30% Off Apple Accessories
2 days ago
Google Wallet Available on iPhone, But Without Tap to Pay
Google Wallet Available on iPhone, But Without Tap to Pay
2 days ago
Apple Accounts, App Store and Apple Music Experiencing Issues
Apple Accounts, App Store and Apple Music Experiencing Issues
2 days ago
Apple Moves Ahead With Better Dual SIM Support for Apps
Apple Moves Ahead With Better Dual SIM Support for Apps
2 days ago
Former Apple Chairman Plans to Sell $32 Million in Apple Stock
Former Apple Chairman Plans to Sell $32 Million in Apple Stock
2 days ago
Apple Accused of Silencing iPhone Duo Supplier Over 'Crackgate' Issue
Apple Accused of Silencing iPhone Duo Supplier Over 'Crackgate' Issue
2 days ago