More Details About iOS 18's AI Features Revealed
Apple is planning to introduce new AI features including Smart Replies for messages and a generative retouch tool for photos in iOS 18, a new report claims.
A new article from AppleInsider today revealed some further detail about several of iOS 18's widely anticipated AI features. Siri is rumored to receive some major upgrades including:
- Improved Responses: Significantly updated response generation capabilities with a new smart response framework that takes into account entities such as people, companies, calendar events, locations, dates, and more.
- Enhanced Voices: "More natural" voices with better text-to-speech functionality.
- Cross-Device Media Controls: Use Siri on one device to control playback on another, such as via the Apple Watch for the Apple TV. This feature is not expected to arrive until later in 2024.
- Catch Up: Users can request an overview of their recent notifications via Siri.
A range of other AI-powered features are also in the works for specific apps in iOS 18:
- Smart Replies: Allows users to reply to messages and emails with automatically generated text responses.
- Transcription and Summarization: New AI tools for the Notes app allowing users to edit audio in the app, transcribe audio, and summarize text.
- Math Notes: Support for proper mathematical notation in the Notes app with Calculator app integation. Math Notes will allow the Notes app to recognise mathematical equations and come up with solutions and generate graphs.
- Keyboard Math Predictions: Input enhancements for mathematics enabling the completion of complex mathematical expressions when recognised as part of text input, similar to predictive text or inline text completion.
- Clean Up: Remove objects from photos using generative AI. This tool will replace Apple's current "Retouch" feature.
- Generative Playground: Application that uses generative AI to create and edit images with an iMessage app extension. It is currently designed for Apple's internal test environments only, but indicates that there are plans to allow users to generate images and then share them via iMessage. This could be related to rumored plans to allow users to generate custom emojis.
visionOS 2 will also apparently gain an improved predictive text model thanks to integration with Apple's Transformer LM, as well as a redesigned Voice Commands UI. Updates to the Calendar and Freeform apps, as well as System Settings for macOS, are also said to be planned. Apple's selection of new AI features are expected to be previewed during the company's WWDC keynote on June 10.
Popular Stories
Apple plans to announce new products "this week," according to Bloomberg's Mark Gurman.
Apple's "Mac Your Calendars" teaser last October
In his Power On newsletter today, Gurman said the products set to be updated this week include the iPad Pro, Vision Pro, and "likely" the base 14-inch MacBook Pro, with all three likely to receive a spec bump with Apple's next-generation M5 chip.
Gurman...
Buried in its announcement about "F1: The Movie" making its streaming debut on December 12, Apple has also announced that Apple TV+ is being rebranded as simply Apple TV.
A single line near the end of the press release states "Apple TV+ is now simply Apple TV, with a vibrant new identity," though Apple's website has yet to be updated with any changes, so we're unsure on the details of the...
Apple's software engineers are internally testing iOS 26.0.2, according to MacRumors logs, which have been a reliable indicator of upcoming iOS versions.
iOS 26.0.2 will likely be a minor update that addresses bugs and/or security vulnerabilities, but we do not know any specific details yet.
The update will likely be released within the next few weeks.
Last month, Apple released iOS...
Apple today updated the 14-inch MacBook Pro base model with its new M5 chip, which is also available in updated iPad Pro and Vision Pro models.
In addition, the base 14-inch MacBook Pro can now be configured with up to 4TB of storage on Apple's online store, whereas the previous model maxed out at 2TB. However, the maximum amount of unified RAM available for this model remains 32GB.
Like...
Apple marketing chief Greg Joswiak today teased the launch of an upcoming product, saying "something powerful is coming" on social media.
Subscribe to the MacRumors YouTube channel for more videos.
A short animation accompanying Joswiak's teaser reveals a brief glimpse of a MacBook Pro along with the words "coming soon." The shape of the MacBook Pro is a V, which is the Roman numeral...
Apple today announced the next-generation iPad Pro, featuring the custom-designed M5, C1X, and N1 chips.
The M5 chip has up to a 10-core CPU, with four performance cores and six efficiency cores. It features a next-generation GPU with Neural Accelerator in each core, allowing the new iPad Pro to deliver up to 3.5x the AI performance than the previous model, and a third-generation ray-tracing ...
While the iPhone 18 Pro and iPhone 18 Pro Max are still nearly a year away, a handful of new features and changes have already been rumored for the devices.
Below, we have recapped some of the early iPhone 18 Pro rumors so far.
Smaller Dynamic Island
The standard iPhone 18, iPhone 18 Pro, and iPhone 18 Pro Max will be equipped with a slightly smaller Dynamic Island, but the devices will...
Apple's AirPods Max have now been available for almost five years, so what do we know about the second-generation version?
According to Apple supply chain analyst Ming-Chi Kuo, the new AirPods Max will be lighter than the current ones, but exactly how much is as yet known. The current AirPods Max weigh 0.85 pounds (386.2 grams), excluding the charging case, making it one of the heavier...
After releasing AirPods Pro 3 last month, Apple is already working on the next AirPods Pro, according to Bloomberg's Mark Gurman.
It is unclear if the new AirPods Pro would be branded as AirPods Pro 4, or if they would be considered an updated version of AirPods Pro 3. Gurman did not take a position, opting to describe them as a "new version" of the "high-end in-ear buds."
AirPods Pro 2...
Apple is going to launch a new version of the MacBook Pro as soon as tomorrow, so we thought we'd go over what to expect from Apple's upcoming Mac.
M5 Chip
The MacBook Pro will be one of the first new devices to use the next-generation M5 chip, which will replace the M4 chip.
The M5 is built on TSMC's more advanced 3-nanometer process, and it will bring speed and efficiency improvements. ...
