Ollama Now Runs Faster on Macs Thanks to Apple's MLX Framework
Ollama, the popular app for running AI models locally on a computer, has released an update that takes advantage of Apple's own machine learning framework, MLX. The result is a hefty speed boost on Macs with Apple silicon.
According to Ollama, the new version processes prompts around 1.6 times faster (prefill speed) and nearly doubles the speed at which it generates responses (decode speed). Macs with M5-series chips are said to see the largest improvements, thanks to Apple's new GPU Neural Accelerators.
The update also includes smarter memory management, which should make AI-powered coding tools and chat assistants feel noticeably more responsive during extended use.
Ollama says the new performance boost should especially benefit macOS users who run personal assistants like OpenClaw or coding agents like Claude Code, OpenCode, or Codex.
The preview release is available to download as Ollama 0.19 – just make sure you have a Mac with more than 32GB of unified memory to run it. Support is currently limited to Alibaba's Qwen3.5, but Ollama says support for more AI models is planned.
Popular Stories
Bloomberg's Mark Gurman has high expectations for Apple's first foldable iPhone.
In his Power On newsletter today, he said the foldable iPhone will be "the most significant overhaul in the iPhone's history."
"iPhone 4, iPhone 6 and iPhone X were clearly a big deal, but this is a whole new design," he said.
Like Samsung's Galaxy Z Fold 7, the foldable iPhone will reportedly open up like ...
March has been an incredibly busy month for Apple, with the company unveiling more than 10 new products and accessories. We said hello to the MacBook Neo at the start of the month, and we bid farewell to the Mac Pro at the end of it.
Nevertheless, there is still a lot more to come this year.
Beyond the usual annual updates to iPhones and Apple Watches, Apple's all-new smart home hub is...
Apple is expected to release two new iPhone apps this year, including an Apple Business app and a Siri app with chatbot-like functionality.
With the Apple Business app, employees at businesses using the new Apple Business platform will be able to install apps for work, view contact information for colleagues, and request support. Apple Business is launching on April 14, and it replaces Apple ...
Popular Stories
Bloomberg's Mark Gurman has high expectations for Apple's first foldable iPhone.
In his Power On newsletter today, he said the foldable iPhone will be "the most significant overhaul in the iPhone's history."
"iPhone 4, iPhone 6 and iPhone X were clearly a big deal, but this is a whole new design," he said.
Like Samsung's Galaxy Z Fold 7, the foldable iPhone will reportedly open up like ...
March has been an incredibly busy month for Apple, with the company unveiling more than 10 new products and accessories. We said hello to the MacBook Neo at the start of the month, and we bid farewell to the Mac Pro at the end of it.
Nevertheless, there is still a lot more to come this year.
Beyond the usual annual updates to iPhones and Apple Watches, Apple's all-new smart home hub is...
Apple is expected to release two new iPhone apps this year, including an Apple Business app and a Siri app with chatbot-like functionality.
With the Apple Business app, employees at businesses using the new Apple Business platform will be able to install apps for work, view contact information for colleagues, and request support. Apple Business is launching on April 14, and it replaces Apple ...
