Here's How Apple is Working to Improve Apple Intelligence

With its uncompromising focus on user privacy, Apple has faced challenges collecting enough data to train the large language models that power Apple Intelligence features and that will ultimately improve Siri.

apple intelligence black
To improve ‌Apple Intelligence‌, Apple has to come up with privacy preserving options for AI training, and some of the methods the company is using have been outlined in a new Machine Learning Research blog post.

Basically, Apple needs user data to improve summarization, writing tools, and other ‌Apple Intelligence‌ features, but it doesn't want to collect data from individual users. So instead, Apple has worked out a way to understand usage trends using differential privacy and data that's not linked to any one person. Apple is creating synthetic data that is representative of aggregate trends in real user data, and it is using on-device detection to make comparisons, providing the company with insight without the need to access sensitive information.

It works like this: Apple generates multiple synthetic emails on topics that are common in user emails, such as an invitation to play a game of tennis at 3:00 p.m. Apple then creates an "embedding" from that email with specific language, topic, and length info. Apple might create several embeddings with varying email length and information.

Those embeddings are sent to a small number of iPhone users who have Device Analytics turned on, and the iPhones that receive the embeddings select a sample of actual user emails and compute embeddings for those actual emails. The synthetic embeddings that Apple created are compared to the embedding for the real email, and the user's ‌iPhone‌ decides which of the synthetic embeddings is closest to the actual sample.

Apple then uses differential privacy to determine which of the synthetic embeddings are most commonly selected across all devices, so it knows how emails are most commonly worded without ever seeing user emails and without knowing which specific devices selected which embeddings as the most similar.

Apple says that the most frequently selected synthetic embeddings it collects can be used to generate training or testing data, or can be used as examples for further data refinement. The process provides Apple with a way to improve the topics and language of synthetic emails, which in turn trains models to create better text outputs for email summaries and other features, all without violating user privacy.

Apple does something similar for Genmoji, using differential privacy to identify popular prompts and prompt patterns that can be used to improve the image generation feature. Apple uses a technique to ensure that it only receives ‌Genmoji‌ prompts that have been used by hundreds of people, and nothing specific or unique that could identify an individual person.

Apple can't see ‌Genmoji‌ associated with a personal device, and all signals that are relayed are anonymized and include random noise to hide user identity. Apple also doesn't link any data with an IP address or ID that could be associated with an Apple Account.

With both of these methods, only users that have opted-in to send Device Analytics to Apple participate in the testing, so if you don't want to have your data used in this way, you can turn that option off.

Apple plans to expand its use of differential privacy techniques for improving Image Playground, Memories Creation, Writing Tools, and Visual Intelligence in iOS 18.5, iPadOS 18.5, and macOS Sequoia 15.5.

Popular Stories

AirPods Pro 3 Mock Feature

AirPods Pro 3 Just Months Away – Here's What We Know

Friday April 18, 2025 5:16 am PDT by
Despite being more than two years old, Apple's AirPods Pro 2 still dominate the premium wireless‑earbud space, thanks to a potent mix of top‑tier audio, class‑leading noise cancellation, and Apple's habit of delivering major new features through software updates. With AirPods Pro 3 widely expected to arrive in 2025, prospective buyers now face a familiar dilemma: snap up the proven...
CarPlay Hero

Apple Releases Wireless CarPlay Fix

Wednesday April 16, 2025 11:28 am PDT by
If you have been experiencing issues with wireless CarPlay in your vehicle lately, it was likely due to a software bug that has now been fixed. Apple released iOS 18.4.1 today, and the update's release notes say it "addresses a rare issue that prevents wireless CarPlay connection in certain vehicles." If wireless CarPlay was acting up for you, updating your iPhone to iOS 18.4.1 should...
iphone 16 pro models 1

17 Reasons to Wait for the iPhone 17

Thursday April 17, 2025 4:12 am PDT by
Apple's iPhone development roadmap runs several years into the future and the company is continually working with suppliers on several successive iPhone models simultaneously, which is why we often get rumored features months ahead of launch. The iPhone 17 series is no different, and we already have a good idea of what to expect from Apple's 2025 smartphone lineup. If you skipped the iPhone...
Beyond iPhone 13 Better Triad

Apple's 20th Anniversary iPhone May Finally Go All Screen

Tuesday April 15, 2025 6:31 am PDT by
Apple is preparing a "bold" new iPhone Pro model for the iPhone's 20th anniversary in 2027, according to Bloomberg's Mark Gurman. As part of what's being described as a "major shake-up," Apple is said to be developing a design that makes more extensive use of glass – and this could point directly to the display itself. Here's the case for Apple releasing a truly all-screen iPhone with no...
maxresdefault

iPhone 17 Pro Launching Later This Year With These 12 New Features

Sunday April 13, 2025 7:52 am PDT by
While the iPhone 17 Pro and iPhone 17 Pro Max are not expected to launch until September, there are already plenty of rumors about the devices. Subscribe to the MacRumors YouTube channel for more videos. Below, we recap key changes rumored for the iPhone 17 Pro models as of April 2025: Aluminum frame: iPhone 17 Pro models are rumored to have an aluminum frame, whereas the iPhone 15 Pro and ...
iOS 19 Roundup Feature

iOS 19 Will Add These New Features to Your iPhone

Tuesday April 15, 2025 7:37 am PDT by
The first iOS 19 beta is less than two months away, and there are already a handful of new features that are expected with the update. Apple should release the first iOS 19 beta to developers immediately following the WWDC 2025 keynote, which is scheduled for Monday, June 9. Following beta testing, the update should be released to the general public in September. Below, we recap the key...
tvOS 18 Thumb 1

Apple Releases tvOS 18.4.1

Wednesday April 16, 2025 10:04 am PDT by
Apple today released tvOS 18.4.1, a minor update to the tvOS 18 operating system that came out last September. tvOS 18.4.1 comes two weeks after Apple released tvOS 18.4, and it is available for the Apple TV 4K and Apple TV HD models. tvOS 18.4.1 can be downloaded using the Settings app on the ‌Apple TV‌. Open up Settings and go to System > Software Update to get the new software....
iPhone Security Feature 25

Five iPhone Security Features You Should Be Using

Wednesday April 16, 2025 4:15 pm PDT by
Apple has quite a few security features that it's added to iPhones, iPads, and Macs over the years. Now more than ever, it's important to make sure you're taking advantage of the built-in security tools that are available to keep yourself and your data safe, so we've rounded up a list of the most important options. If you don't already have these enabled, you might want to consider turning...
vision air cable

Images of Apple 'Vision Air' Power Cable Emerge Online

Thursday April 17, 2025 5:55 am PDT by
More images of a redesigned power cable allegedly for a future Apple "Vision Air" headset were today shared online by the prototype collector and leaker known as "Kosutami." Yesterday, the leaker explained that the Apple "Vision Air" will feature a thinner design and switch the battery enclosure and several of its internal structures to titanium to reduce the device's overall weight. Most of ...

Top Rated Comments

Martius Avatar
6 days ago at 01:11 pm
I can't help but think of this part of one of Steve Jobs's best interviews when it comes to this Siri failure.

Score: 23 Votes (Like | Disagree)
Daalseth Avatar
6 days ago at 01:10 pm
But the fact is I don’t WANT summarization or writing tools. As long as that and other generative AI stuff is Apple’s focus I will leave it off. How about a spelling checker that wasn’t an idiot? That I might go for. But the rest of what they have delivered, and advertised but not delivered, is not anything I want anywhere near my systems.
Score: 20 Votes (Like | Disagree)
d-klumpp Avatar
6 days ago at 01:13 pm
So my emails can sound perfectly average?! This has zero interest for me -- I prefer typing myself with the hope of injecting some of my own personality. Crowd sourcing a generic response is a terrible idea.
Score: 14 Votes (Like | Disagree)
HiRez Avatar
6 days ago at 01:41 pm
This might be more interesting if they hadn't kept telling us they were making Siri better for the last 14 years.
Score: 14 Votes (Like | Disagree)
GfPQqmcRKUvP Avatar
6 days ago at 02:04 pm
Imagine believing Apple is so behind in AI because of their commitment to privacy lol
Score: 9 Votes (Like | Disagree)
eoblaed Avatar
6 days ago at 01:51 pm

So my emails can sound perfectly average?! This has zero interest for me -- I prefer typing myself with the hope of injecting some of my own personality. Crowd sourcing a generic response is a terrible idea.
This article was focused on how they're going to improve summaries you see when looking at lists of emails (which I find quite helpful even in their current state). Nothing about generating a generic voice for authoring emails.
Score: 8 Votes (Like | Disagree)