Apple Uses Amazon's Custom AI Chips for Search Services - MacRumors
Skip to Content

Apple Uses Amazon's Custom AI Chips for Search Services

by

Apple uses custom Inferentia and Graviton artificial intelligence chips from Amazon Web Services for search services, Apple machine learning and AI director Benoit Dupin said today at the AWS re:Invent conference (via CNBC).

aws trainium
Dupin said that Amazon's AI chips are "reliable, definite, and able to serve [Apple] customers worldwide." AWS and Amazon have a "strong relationship," and Apple plans to test whether Amazon's Trainium2 chip can be used for pre-training Apple Intelligence and other AI models. Amazon announced rental opportunities for the Trainium2 chip today.

Apple has used AWS for more than 10 years for Siri, Apple Maps, and Apple Music. With Amazon's Inferentia and Graviton chips, Apple has seen a 40 percent efficiency gain, and with Trainium2, Dupin said Apple expects up to a 50 percent improvement in efficiency with pre-training.

Nvidia is the market leader when it comes to GPUs for AI training, but companies like Amazon are aiming to compete with lower-cost options.

Tag: Amazon

Top Rated Comments

orbital~debris Avatar
orbital~debris
18 months ago

AWS and Amazon have a "strong relationship,"
I should hope so 🤣
Score: 19 Votes (Like | Disagree)
cateye Avatar
cateye
18 months ago

Great...
One one side Open AI, on the other Amazon.
What's next, Meta?
There's marketing, and then there's business. Apple does significant business with Google and Microsoft, too. As I'm sure Microsoft does business with Oracle, and Google with Meta, and Amazon with Apple, and on down the line, every possible combination.

The "my favorite company is more pious and pure than your favorite company" is sports ball-style chum for ad impressions on sites like this one. The reality is, they all work together, as it suits them, because that's how business works. Efficiency first.
Score: 16 Votes (Like | Disagree)
JippaLippa Avatar
JippaLippa
18 months ago
Great...
One one side Open AI, on the other Amazon.
What's next, Meta?
Score: 8 Votes (Like | Disagree)
magicschoolbus Avatar
magicschoolbus
18 months ago
My amazon shares welcome this news.
Score: 7 Votes (Like | Disagree)
A
anakin44011
18 months ago
So...can I have one of those chips for my MacBook?

...because Spotlight Search has become progressively worse over time. Its speed and top suggestions are almost laughable.

...or is it just me...and the last three M-Series MacBooks I've purchased?
Score: 6 Votes (Like | Disagree)
N
novagamer
18 months ago
Wish they used AMD so ROCm wouldn’t be such a pile of hot garbage.


Apple Intelligence summarized an email by saying it was me who was leaving the US congress in a few weeks.

…

Maybe it’s just me, but while it was more basic ten years ago, I swear Siri worked better for fundamental tasks like playing songs and playlists. Pretty underwhelming thus far.
It’s not just you, GenAI cannot summarize – it’s a key area they not only struggle with but functionally can not do well.

I invite anyone wants to argue with me to please reply with research papers, I’ve asked before and I’ll ask again in the future… I’m deeply involved in this area and would love someone to figure out how to crack that problem or point me to newer research that even attempts to do so and has measurable success.

Until then, it is puzzling why it was one of the first features they rolled out. It intuitively seems like it can summarize, but it just can not. Statistics and regression aren’t the same thing as critical human thought and novel synthesis.

I don’t hate GemAI, but I wish there was more responsible roll-out of the tooling and more understanding / openness about the limitations.
Score: 5 Votes (Like | Disagree)
Read All Comments