More Details About iOS 18's AI Features Revealed

Apple is planning to introduce new AI features including Smart Replies for messages and a generative retouch tool for photos in iOS 18, a new report claims.

Apple Silicon AI Optimized Feature Siri 1
A new article from AppleInsider today revealed some further detail about several of ‌iOS 18‌'s widely anticipated AI features. Siri is rumored to receive some major upgrades including:

  • Improved Responses: Significantly updated response generation capabilities with a new smart response framework that takes into account entities such as people, companies, calendar events, locations, dates, and more.
  • Enhanced Voices: "More natural" voices with better text-to-speech functionality.
  • Cross-Device Media Controls: Use ‌Siri‌ on one device to control playback on another, such as via the Apple Watch for the Apple TV. This feature is not expected to arrive until later in 2024.
  • Catch Up: Users can request an overview of their recent notifications via ‌Siri‌.

A range of other AI-powered features are also in the works for specific apps in ‌iOS 18‌:

  • Smart Replies: Allows users to reply to messages and emails with automatically generated text responses.
  • Transcription and Summarization: New AI tools for the Notes app allowing users to edit audio in the app, transcribe audio, and summarize text.
  • Math Notes: Support for proper mathematical notation in the Notes app with Calculator app integation. Math Notes will allow the Notes app to recognise mathematical equations and come up with solutions and generate graphs.
  • Keyboard Math Predictions: Input enhancements for mathematics enabling the completion of complex mathematical expressions when recognised as part of text input, similar to predictive text or inline text completion.
  • Clean Up: Remove objects from photos using generative AI. This tool will replace Apple's current "Retouch" feature.
  • Generative Playground: Application that uses generative AI to create and edit images with an iMessage app extension. It is currently designed for Apple's internal test environments only, but indicates that there are plans to allow users to generate images and then share them via iMessage. This could be related to rumored plans to allow users to generate custom emojis.

visionOS 2 will also apparently gain an improved predictive text model thanks to integration with Apple's Transformer LM, as well as a redesigned Voice Commands UI. Updates to the Calendar and Freeform apps, as well as System Settings for macOS, are also said to be planned. Apple's selection of new AI features are expected to be previewed during the company's WWDC keynote on June 10.

Related Roundups: iOS 18, iPadOS 18
Related Forums: iOS 18, iPadOS 18

Popular Stories

Apple Vision Pro 2 Feature 2

Apple Reportedly Suspends Work on Vision Pro 2

Tuesday June 18, 2024 8:17 am PDT by
Apple has suspended work on the second-generation Vision Pro headset to singularly focus on a cheaper model, The Information reports. Apple was widely believed to have plans to divide its Vision product line into two models, with one "Pro" model and one lower-cost standard model. The company is said to have been deprioritizing the next Vision Pro headset over the past year, gradually...
Apple WWDC24 Apple Intelligence hero 240610

Apple Explains iPhone 15 Pro Requirement for Apple Intelligence

Wednesday June 19, 2024 4:48 am PDT by
With iOS 18, iPadOS 18, and macOS Sequoia, Apple is introducing a new personalized AI experience called Apple Intelligence that uses on-device, generative large-language models to enhance the user experience across iPhone, iPad, and Mac. These new AI features require Apple's latest iPhone 15 Pro and iPhone 15 Pro Max models to work, while only Macs and iPads with M1 or later chips will...
M4 Real Feature Red

M4 MacBook Pro Models Expected to Launch in Late 2024

Tuesday June 18, 2024 10:50 am PDT by
MacBook Pro models with an M4 chip are expected to launch in the fourth quarter of 2024, according to display analyst Ross Young. In a tweet for subscribers, Young said that panel shipments for new 14-inch and 16-inch MacBook Pro models are set to begin in the third quarter of 2024, which suggests a launch toward the end of the year. Apple started its M4 chip refresh in May with the launch...
2022 back to school apple feature

Apple's 2024 Back to School Sale Launching This Week

Monday June 17, 2024 12:27 pm PDT by
Apple will launch its annual Back to School promotion for university students in the United States and Canada this week, according to Bloomberg's Mark Gurman. Apple's back to school sales provide students with a free Apple gift card when purchasing a Mac or an iPad, and this year's promotion could help Apple push the new M2 iPad Air and M4 iPad Pro models. Last year, Apple offered U.S....
iOS 18 Calendar Feature

iOS 18: Calendar App Design Changes and Reminders Integration

Tuesday June 18, 2024 6:16 am PDT by
Apple in iOS 18 has given the Calendar app a major update, adding some welcome interface design changes, not to mention long-awaited integration with Reminders. In the month-by-month calendar view, the month now appears in large bold font in the top left, while the Events list toggle has been replaced by a new button that lets you choose between Compact, Stacked, Details, and List views. ...
watchOS 11 Thumb 2 1

watchOS 11 Supports Automatic Nap Detection

Monday June 17, 2024 4:05 pm PDT by
watchOS 11 appears to include a new feature that allows an Apple Watch to automatically detect and record when you're taking a nap. As shared on Reddit, an Apple Watch owner took a nap and was able to see the sleep data recorded in the Health app, despite not putting the device in Sleep Mode. Right now, the Apple Watch only tracks and records sleep when it is in Sleep Mode, and there is no...

Top Rated Comments

tomtad Avatar
3 weeks ago
Adding in features Google have had for years. Apple is really struggling here with years of underinvestment in this area
Score: 12 Votes (Like | Disagree)
GrayFlannel Avatar
3 weeks ago
None of these features would be possible if not for AI? ?
It would be nice if someone would start to provide the benefit features would receive from “AI” with specificity.
Score: 11 Votes (Like | Disagree)
BanjoDudeAhoy Avatar
3 weeks ago

None of these features would be possible if not for AI? ?
It would be nice if someone would start to provide the benefit features would receive from “AI” with specificity.
Kinda what I was thinking, too.
I feel like this is more in line with everyone else slapping a new label on an existing product that reads, “now with 100% more AI” with a logo that insinuates magic to tick buzzword boxes.
Score: 9 Votes (Like | Disagree)
abatabia Avatar
3 weeks ago
Cautiously optimistic is how I feel about all of this.
Score: 8 Votes (Like | Disagree)
WWPD Avatar
3 weeks ago
Does this mean that AI will learn to send a text to my boss Monday morning that I will be out "sick"? Hopefully it's smart enough to leave out the quotes.
Score: 8 Votes (Like | Disagree)
Foxglove9 Avatar
3 weeks ago
None of these features are something I would find useful. Curious to see what else will develop. Also possible iPadOS enhancements?
Score: 8 Votes (Like | Disagree)