More Details About iOS 18's AI Features Revealed

Apple is planning to introduce new AI features including Smart Replies for messages and a generative retouch tool for photos in iOS 18, a new report claims.

Apple Silicon AI Optimized Feature Siri 1
A new article from AppleInsider today revealed some further detail about several of ‌iOS 18‌'s widely anticipated AI features. Siri is rumored to receive some major upgrades including:

  • Improved Responses: Significantly updated response generation capabilities with a new smart response framework that takes into account entities such as people, companies, calendar events, locations, dates, and more.
  • Enhanced Voices: "More natural" voices with better text-to-speech functionality.
  • Cross-Device Media Controls: Use ‌Siri‌ on one device to control playback on another, such as via the Apple Watch for the Apple TV. This feature is not expected to arrive until later in 2024.
  • Catch Up: Users can request an overview of their recent notifications via ‌Siri‌.

A range of other AI-powered features are also in the works for specific apps in ‌iOS 18‌:

  • Smart Replies: Allows users to reply to messages and emails with automatically generated text responses.
  • Transcription and Summarization: New AI tools for the Notes app allowing users to edit audio in the app, transcribe audio, and summarize text.
  • Math Notes: Support for proper mathematical notation in the Notes app with Calculator app integation. Math Notes will allow the Notes app to recognise mathematical equations and come up with solutions and generate graphs.
  • Keyboard Math Predictions: Input enhancements for mathematics enabling the completion of complex mathematical expressions when recognised as part of text input, similar to predictive text or inline text completion.
  • Clean Up: Remove objects from photos using generative AI. This tool will replace Apple's current "Retouch" feature.
  • Generative Playground: Application that uses generative AI to create and edit images with an iMessage app extension. It is currently designed for Apple's internal test environments only, but indicates that there are plans to allow users to generate images and then share them via iMessage. This could be related to rumored plans to allow users to generate custom emojis.

visionOS 2 will also apparently gain an improved predictive text model thanks to integration with Apple's Transformer LM, as well as a redesigned Voice Commands UI. Updates to the Calendar and Freeform apps, as well as System Settings for macOS, are also said to be planned. Apple's selection of new AI features are expected to be previewed during the company's WWDC keynote on June 10.

Related Roundups: iOS 18, iPadOS 18
Related Forums: iOS 18, iPadOS 18

Popular Stories

iPhone 17 Plus Feature

iPhone 17 Lineup Specs Detail Display Upgrade and New High-End Model

Monday July 22, 2024 4:33 am PDT by
Key details about the overall specifications of the iPhone 17 lineup have been shared by the leaker known as "Ice Universe," clarifying several important aspects of next year's devices. Reports in recent months have converged in agreement that Apple will discontinue the "Plus" iPhone model in 2025 while introducing an all-new iPhone 17 "Slim" model as an even more high-end option sitting...
iPhone SE 4 Vertical Camera Feature

iPhone SE 4 Production Will Reportedly Begin Ramping Up in October

Tuesday July 23, 2024 2:00 pm PDT by
Following nearly two years of rumors about a fourth-generation iPhone SE, The Information today reported that Apple suppliers are finally planning to begin ramping up mass production of the device in October of this year. If accurate, that timeframe would mean that the next iPhone SE would not be announced alongside the iPhone 16 series in September, as expected. Instead, the report...
Generic iPhone 17 Feature With Full Width Dynamic Island

Kuo: Ultra-Thin iPhone 17 to Feature A19 Chip, Single Rear Camera, Semi-Titanium Frame, and More

Wednesday July 24, 2024 9:06 am PDT by
Apple supply chain analyst Ming-Chi Kuo today shared alleged specifications for a new ultra-thin iPhone 17 model rumored to launch next year. Kuo expects the device to be equipped with a 6.6-inch display with a current-size Dynamic Island, a standard A19 chip rather than an A19 Pro chip, a single rear camera, and an Apple-designed 5G chip. He also expects the device to have a...
iPhone 17 Plus Feature Purple

These 5 Features Will Make the iPhone 17 the Biggest Update in Years

Monday July 22, 2024 4:02 pm PDT by
The upcoming iPhone 16 models that we're expecting to see in September are going to be quite similar to the iPhone 15 models, but rumors suggest that Apple is making big changes in 2025. We've been hearing hints of an all-new device in the iPhone lineup, and it may be the most expensive iPhone Apple has offered to date. New 'Slim' Design Rumors have taken to referring to the new iPhone 17...
iOS 18 on iPhone Feature

Everything New in iOS 18 Beta 4

Tuesday July 23, 2024 1:08 pm PDT by
Apple released the fourth beta of iOS 18 today, introducing small changes to a number of features throughout the operating system. There are no big additions in this beta, but Apple is continuing to refine existing settings and design choices. Apple plans to continue updating iOS 18 over the next few months, with the update set to be released this fall. We've rounded up all of the changes...
iPhone SE 4 Thumb 1

iPhone SE 4 Rumored to Launch Early Next Year With OLED Display, 48MP Camera, and More

Monday July 22, 2024 7:22 am PDT by
The fourth-generation iPhone SE will offer a series of major upgrades over the current model, the leaker known as "Ice Universe" claims. The information was listed in a post on Weibo, which also detailed the specifications of the iPhone 17 lineup. As previously rumored, the fourth-generation iPhone SE is expected to feature Face ID and USB-C, marking a major upgrade from current and previous ...
iPhone 17 Plus Feature Purple

iPhone 17 Rumored to Feature Mechanical Aperture

Tuesday July 23, 2024 9:32 am PDT by
Apple is planning to release at least one iPhone 17 model next year with mechanical aperture, according to a report published today by The Information. The mechanical system would allow users to adjust the size of the iPhone 17's aperture, which refers to the opening of the camera lens through which light enters. All existing iPhone camera lenses have fixed apertures, but some Android...

Top Rated Comments

tomtad Avatar
8 weeks ago
Adding in features Google have had for years. Apple is really struggling here with years of underinvestment in this area
Score: 12 Votes (Like | Disagree)
GrayFlannel Avatar
8 weeks ago
None of these features would be possible if not for AI? ?
It would be nice if someone would start to provide the benefit features would receive from “AI” with specificity.
Score: 11 Votes (Like | Disagree)
BanjoDudeAhoy Avatar
8 weeks ago

None of these features would be possible if not for AI? ?
It would be nice if someone would start to provide the benefit features would receive from “AI” with specificity.
Kinda what I was thinking, too.
I feel like this is more in line with everyone else slapping a new label on an existing product that reads, “now with 100% more AI” with a logo that insinuates magic to tick buzzword boxes.
Score: 9 Votes (Like | Disagree)
abatabia Avatar
8 weeks ago
Cautiously optimistic is how I feel about all of this.
Score: 8 Votes (Like | Disagree)
WWPD Avatar
8 weeks ago
Does this mean that AI will learn to send a text to my boss Monday morning that I will be out "sick"? Hopefully it's smart enough to leave out the quotes.
Score: 8 Votes (Like | Disagree)
Foxglove9 Avatar
8 weeks ago
None of these features are something I would find useful. Curious to see what else will develop. Also possible iPadOS enhancements?
Score: 8 Votes (Like | Disagree)