Apple Used Google Tensor Chips to Develop Apple Intelligence

Apple used Tensor Processing Units (TPUs) developed by Google instead of Nvidia's widely-used graphics processing units (GPUs) to construct two critical components of Apple Intelligence.

Apple Intelligence General Feature
The decision is detailed in a new research paper published by Apple that highlights its reliance on Google's cloud hardware (via CNBC). The paper reveals that Apple utilized 2,048 of Google's TPUv5p chips to build AI models and 8,192 TPUv4 processors for server AI models. The research paper does not mention Nvidia explicitly, but the absence of any reference to Nvidia's hardware in the description of Apple's AI infrastructure is telling and this omission suggests a deliberate choice to favor Google's technology.

The decision is noteworthy given Nvidia's dominance in the AI processor market and since Apple very rarely discloses its hardware choices for development purposes. Nvidia's GPUs are highly sought after for AI applications due to their performance and efficiency. Unlike Nvidia, which sells its chips and systems as standalone products, Google provides access to its TPUs through cloud services. Customers using Google's TPUs have to develop their software within Google's ecosystem, which offers integrated tools and services to streamline the development and deployment of AI models.

In the paper, Apple's engineers explain that the TPUs allowed them to train large, sophisticated AI models efficiently. They describe how Google's TPUs are organized into large clusters, enabling the processing power necessary for training Apple's AI models. Apple has announced plans to invest over $5 billion in AI server enhancements over the next two years, which should bolster its AI capabilities and reduce its dependence on external hardware providers.

In addition to detailing its use of Google's TPUs, the paper addresses ethical considerations in AI development. Apple emphasized its adherence to responsible data practices, claiming that no private user data was used in training its AI models. The company relied on a mix of publicly available, licensed, and open-sourced datasets for training purposes. Apple added that its training data set, which includes publicly available web data and licensed content, was curated to protect user privacy.

Popular Stories

New Things Your iPhone Can Do in iOS 18

10 New Things Your iPhone Can Do in iOS 18.2

Thursday October 31, 2024 9:42 am PDT by
Apple is set to release iOS 18.2 in December, bringing the second round of Apple Intelligence features to iPhone 15 Pro and iPhone 16 models. This update brings several major advancements to Apple's AI integration, including completely new image generation tools and a range of Visual Intelligence-based enhancements. There are a handful of new non-AI related feature controls incoming as well. ...
Apple MacBook Pro M4 Cinema 4D Slack Finder Xcode 1

Apple Announces MacBook Pro Models With M4 Pro and M4 Max Chips, Thunderbolt 5 Support, and More

Wednesday October 30, 2024 8:01 am PDT by
Apple today announced new 14-inch and 16-inch MacBook Pro models featuring M4 Pro and M4 Max chips, alongside a new entry-level 14-inch MacBook Pro powered by the M4 chip. Subscribe to the MacRumors YouTube channel for more videos. The new M4 Pro and M4 Max machines come with a minimum of 24GB of Unified Memory as standard, up from 18GB in the previous models. Both models feature three...
M4 Pro on Blue

M4 Pro Chip Benchmark Results Reveal an Extremely Impressive Performance Feat

Thursday October 31, 2024 7:06 pm PDT by
The first Geekbench 6 benchmark results for the M4 Pro chip surfaced today. Impressively, the results that are available so far show that the highest-end M4 Pro chip is faster than the highest-end M2 Ultra chip in terms of peak multi-core CPU performance. Here is a comparison of the results: Mac mini with M4 Pro (14-core CPU): 22,094 multi-core score (average of 11 results) Mac Studio...
m3 macbook air blue

Apple Announces MacBook Air Now Starts With Increased 16GB of RAM With No Price Increase

Wednesday October 30, 2024 8:04 am PDT by
Apple today in its new MacBook Pro press release announced that the MacBook Air lineup now starts with 16GB of RAM, up from 8GB previously. This change applies to the 13-inch model with the M2 chip, the 13-inch model with the M3 chip, and the 15-inch model with the M3 chip. In the U.S., the MacBook Air lineup continues to start at $999, so there is no price increase associated with the...
maxresdefault

Apple Announces Redesigned Mac Mini With M4 and M4 Pro Chips, Two Front USB-C Ports, and More

Tuesday October 29, 2024 8:01 am PDT by
Apple today announced fully redesigned Mac mini models featuring the M4 and M4 Pro chips, a considerably smaller casing, two front-facing USB-C ports, Thunderbolt 5 connectivity, and more. Subscribe to the MacRumors YouTube channel for more videos. The product refresh marks the first time the Mac mini has been redesigned in over a decade. The enclosure now measures just five by five inches...
Apple iPhone SE 4 5G Modem 1

iPhone SE 4 First to Get Apple-Designed 5G Modem, iPhone 17 Pro to Add Custom Wi-Fi 7 Chip

Friday November 1, 2024 4:04 am PDT by
The iPhone SE 4 that's set to come out early next year is expected to debut Apple's first in-house 5G modem, according to Jeff Pu, an analyst who covers companies within Apple's supply chain. In a research note this week with Hong Kong-based investment firm Haitong International Securities, Pu said Apple is expected to roll out its custom-made 5G modem starting with the next-generation...
Apple MacBook Pro M4 hero

Skipping the New MacBook Pro? Here Are Two Bigger Changes Rumored

Thursday October 31, 2024 4:00 pm PDT by
While the new MacBook Pro lineup features faster M4 chip options, Thunderbolt 5 support for higher-end configurations, a nano-texture display option, and more, most of the previous MacBook Pro models with Apple silicon chips still offer the latest overall design, and fast performance, which might lead you to avoid upgrading this year. If you are planning to skip the new MacBook Pro, here are ...

Top Rated Comments

MacHelp_75 Avatar
14 weeks ago
There is a history between Apple and Nvidia. Lot's of bad blood over GPU's led them to AMD prior to Apple Silicon. If senior leaders are still around who lived through that it may have affected the choice. Speculation obviously, but one supported by history.
Score: 25 Votes (Like | Disagree)
bigboy29 Avatar
14 weeks ago
Responses here are hilarious.

Apple partners with both Google and Microsoft for various cloud things. What they used (the hardware) has absolutely no bearing on the model or Apple's implementation of the model, no? That's kind of like saying "Apple sucks because they use HP in the data center (vs. Dell for example)".

Apple has an initiative called ACDC (Apple Chips in Data Center) which is how they are creating an infrastructure for AI training using their own (M) silicon.

Tensor Vs. Nvidia is kind of like arguing over the brand of shovel you use to dig a trench. It does not mean that Apple Intelligence is all of a sudden a Google Gemini AI rebranded.
Score: 23 Votes (Like | Disagree)
bLackjackj Avatar
14 weeks ago

So not only was Apple reliant on Google services
Apple IS already reliant on Google services. Where do you think icloud resides?? Of course they are going to chose a partner they are already doing business with. Thats called business sense.
Score: 20 Votes (Like | Disagree)
Contact_Feanor Avatar
14 weeks ago

So while Apple may not have used user attributed data, Google still knows exactly what Apple is doing in AI, exactly how their models perform, and can compare their own AI with Apple's AI since they have both.

Sounds like a win-win for Google, Apple not so much. I wonder how much intellectual property Apple is giving up just to say "We can do that too!"

This sounds like a pretty big failure at the executive level.
This isn't exactly true. Cloud based infrastructure usually has pretty good checks in place to protect customer privacy exactly because of this sort of thing. Microsoft can't/doesn't look at everything that's on azure, amazon doesn't look at everything on their web services exactly for this reason.
Score: 19 Votes (Like | Disagree)
mystery hill Avatar
14 weeks ago

Tensor ... chips that are 2yrs behind the industry standard and using old Samsung Foundry manufacturing processes until next year!
Apple aren’t using phone chips found in the Pixels.

They are using Google’s Cloud TPU v5p.

https://cloud.google.com/blog/products/ai-machine-learning/introducing-cloud-tpu-v5p-and-ai-hypercomputer
Score: 11 Votes (Like | Disagree)
cuiver Avatar
14 weeks ago

What an ABSOLUTE JOKE!

Tensor ... chips that are 2yrs behind the industry standard and using old Samsung Foundry manufacturing processes until next year!

This is a colossal failure of endeavor on Apple's part. The ONLY reason to use Tensor chips in 2024 is simply for being efficient in your code as the SoC is garbage! I'm not just talking out my arse here cause even Samsung's much hated SoC the Exynos 2400 outperforms on ALL measurements and in real world tasks and applications as well.

https://www.gsmarena.com/samsung_galaxy_s24_vs_google_pixel_8_review_battery_camera_price_compared-news-62189.php

Sorry ONLY in video playback minutes the Google Pixel 8 which is the tensor chip Apple supposedly used is 'SLIGHTLY' better by just a few minutes more.
They are using Tensor Processing Units (below), not the mobile SoC named Tensor.
Score: 10 Votes (Like | Disagree)