Apple Used Google Tensor Chips to Develop Apple Intelligence
Apple used Tensor Processing Units (TPUs) developed by Google instead of Nvidia's widely-used graphics processing units (GPUs) to construct two critical components of Apple Intelligence.
The decision is detailed in a new research paper published by Apple that highlights its reliance on Google's cloud hardware (via CNBC). The paper reveals that Apple utilized 2,048 of Google's TPUv5p chips to build AI models and 8,192 TPUv4 processors for server AI models. The research paper does not mention Nvidia explicitly, but the absence of any reference to Nvidia's hardware in the description of Apple's AI infrastructure is telling and this omission suggests a deliberate choice to favor Google's technology.
The decision is noteworthy given Nvidia's dominance in the AI processor market and since Apple very rarely discloses its hardware choices for development purposes. Nvidia's GPUs are highly sought after for AI applications due to their performance and efficiency. Unlike Nvidia, which sells its chips and systems as standalone products, Google provides access to its TPUs through cloud services. Customers using Google's TPUs have to develop their software within Google's ecosystem, which offers integrated tools and services to streamline the development and deployment of AI models.
In the paper, Apple's engineers explain that the TPUs allowed them to train large, sophisticated AI models efficiently. They describe how Google's TPUs are organized into large clusters, enabling the processing power necessary for training Apple's AI models. Apple has announced plans to invest over $5 billion in AI server enhancements over the next two years, which should bolster its AI capabilities and reduce its dependence on external hardware providers.
In addition to detailing its use of Google's TPUs, the paper addresses ethical considerations in AI development. Apple emphasized its adherence to responsible data practices, claiming that no private user data was used in training its AI models. The company relied on a mix of publicly available, licensed, and open-sourced datasets for training purposes. Apple added that its training data set, which includes publicly available web data and licensed content, was curated to protect user privacy.
Popular Stories
Apple is set to release iOS 18.2 in December, bringing the second round of Apple Intelligence features to iPhone 15 Pro and iPhone 16 models. This update brings several major advancements to Apple's AI integration, including completely new image generation tools and a range of Visual Intelligence-based enhancements. There are a handful of new non-AI related feature controls incoming as well.
...
Apple today announced new 14-inch and 16-inch MacBook Pro models featuring M4 Pro and M4 Max chips, alongside a new entry-level 14-inch MacBook Pro powered by the M4 chip.
Subscribe to the MacRumors YouTube channel for more videos.
The new M4 Pro and M4 Max machines come with a minimum of 24GB of Unified Memory as standard, up from 18GB in the previous models. Both models feature three...
The first Geekbench 6 benchmark results for the M4 Pro chip surfaced today. Impressively, the results that are available so far show that the highest-end M4 Pro chip is faster than the highest-end M2 Ultra chip in terms of peak multi-core CPU performance.
Here is a comparison of the results:
Mac mini with M4 Pro (14-core CPU): 22,094 multi-core score (average of 11 results)
Mac Studio...
Apple today in its new MacBook Pro press release announced that the MacBook Air lineup now starts with 16GB of RAM, up from 8GB previously.
This change applies to the 13-inch model with the M2 chip, the 13-inch model with the M3 chip, and the 15-inch model with the M3 chip.
In the U.S., the MacBook Air lineup continues to start at $999, so there is no price increase associated with the...
Apple today announced fully redesigned Mac mini models featuring the M4 and M4 Pro chips, a considerably smaller casing, two front-facing USB-C ports, Thunderbolt 5 connectivity, and more.
Subscribe to the MacRumors YouTube channel for more videos.
The product refresh marks the first time the Mac mini has been redesigned in over a decade. The enclosure now measures just five by five inches...
The iPhone SE 4 that's set to come out early next year is expected to debut Apple's first in-house 5G modem, according to Jeff Pu, an analyst who covers companies within Apple's supply chain.
In a research note this week with Hong Kong-based investment firm Haitong International Securities, Pu said Apple is expected to roll out its custom-made 5G modem starting with the next-generation...
While the new MacBook Pro lineup features faster M4 chip options, Thunderbolt 5 support for higher-end configurations, a nano-texture display option, and more, most of the previous MacBook Pro models with Apple silicon chips still offer the latest overall design, and fast performance, which might lead you to avoid upgrading this year.
If you are planning to skip the new MacBook Pro, here are ...