More Details About iOS 18's AI Features Revealed
Apple is planning to introduce new AI features including Smart Replies for messages and a generative retouch tool for photos in iOS 18, a new report claims.
A new article from AppleInsider today revealed some further detail about several of iOS 18's widely anticipated AI features. Siri is rumored to receive some major upgrades including:
- Improved Responses: Significantly updated response generation capabilities with a new smart response framework that takes into account entities such as people, companies, calendar events, locations, dates, and more.
- Enhanced Voices: "More natural" voices with better text-to-speech functionality.
- Cross-Device Media Controls: Use Siri on one device to control playback on another, such as via the Apple Watch for the Apple TV. This feature is not expected to arrive until later in 2024.
- Catch Up: Users can request an overview of their recent notifications via Siri.
A range of other AI-powered features are also in the works for specific apps in iOS 18:
- Smart Replies: Allows users to reply to messages and emails with automatically generated text responses.
- Transcription and Summarization: New AI tools for the Notes app allowing users to edit audio in the app, transcribe audio, and summarize text.
- Math Notes: Support for proper mathematical notation in the Notes app with Calculator app integation. Math Notes will allow the Notes app to recognise mathematical equations and come up with solutions and generate graphs.
- Keyboard Math Predictions: Input enhancements for mathematics enabling the completion of complex mathematical expressions when recognised as part of text input, similar to predictive text or inline text completion.
- Clean Up: Remove objects from photos using generative AI. This tool will replace Apple's current "Retouch" feature.
- Generative Playground: Application that uses generative AI to create and edit images with an iMessage app extension. It is currently designed for Apple's internal test environments only, but indicates that there are plans to allow users to generate images and then share them via iMessage. This could be related to rumored plans to allow users to generate custom emojis.
visionOS 2 will also apparently gain an improved predictive text model thanks to integration with Apple's Transformer LM, as well as a redesigned Voice Commands UI. Updates to the Calendar and Freeform apps, as well as System Settings for macOS, are also said to be planned. Apple's selection of new AI features are expected to be previewed during the company's WWDC keynote on June 10.
Popular Stories
Apple's annual four-day Black Friday through Cyber Monday shopping event is returning on Friday, November 28 through Monday, December 1 in many countries, including the United States, Canada, Australia, New Zealand, France, Germany, Italy, Spain, the United Kingdom, Belgium, the Netherlands, Sweden, Thailand, and others.
During the shopping event, customers can get an Apple gift card with...
Apple's iPhone development roadmap runs several years into the future and the company is continually working with suppliers on several successive iPhone models at the same time, which is why we often get rumored features months ahead of launch. The iPhone 18 series is no different, and we already have a good idea of what to expect for the iPhone 18 Pro and iPhone 18 Pro Max.
One thing worth...
Apple provided developers with the third beta of an upcoming iOS 26.2 update, and there are still new features that are being added with each beta that we get. We've rounded up all of the changes that Apple made in beta 3.
AirDrop
Apple added new AirDrop functionality, providing a way for two people to share files temporarily without having to add one another as contacts.
iOS 26.2...
Apple today announced an expansion of AppleCare+ coverage in India, with new options for monthly and annual plans, and the addition of Theft and Loss for iPhone for the first time.
Options for monthly and annual AppleCare+ plans in India provide more choice and flexibility, allowing users to keep coverage for as long as they require. Apple's vice president of Worldwide iPhone Product...
Apple's eighth-generation iPad mini is highly likely to arrive next year, offering a significant refresh of the device with at least four major new features.
OLED Display
The next-generation version of the iPad mini could feature an OLED display, as part of Apple's plan to expand the display technology across many more of its devices. Apple's first OLED device was the Apple Watch in 2015, ...
A new study has revealed that the iPhone 17, iPhone 17 Pro, iPhone 17 Pro Max, and iPhone Air achieve significantly faster average Wi-Fi speeds compared to the iPhone 16 series, thanks to Apple's custom-designed N1 chip.
The study was conducted by Ookla, the company behind the popular Speedtest website and app. It said the results are based on global, crowdsourced Speedtest user data...
In select U.S. states, residents can add their driver's license or state ID to the Wallet app on the iPhone and Apple Watch, providing a convenient and contactless way to display proof of identity or age at select airports and businesses, and in select apps.
Starting this Wednesday, November 19, the feature will be available to residents of Illinois.
The announcement confirmed that the...
We're getting closer to Black Friday, which lands next week on Friday, November 28. In the lead-up to the shopping holiday, we're tracking a few lowest-ever prices on Apple's most popular Macs, including the M4 MacBook Air and brand new M5 MacBook Pro.
Note: MacRumors is an affiliate partner with some of these vendors. When you click a link and make a purchase, we may receive a small payment,...
Apple today released updated firmware for several accessories, including the 140W USB-C Power Adapter, the Magic Trackpad 2, the Magic Trackpad USB-C, the Magic Keyboard with Touch ID, and the Magic Keyboard with Touch ID and Numeric Keypad.
There is no word on what's included in the updated firmware at this time, but it could offer performance improvements and security updates. Accessory...
Apple Watch owners have been voicing their frustration online over changes to the Workout app that Apple introduced in watchOS 26, with many finding the redesigned interface makes starting exercises difficult and exasperating.
When Apple launched watchOS 26 in September, the Workout app went from large, easily tapped workout tiles to a scrolling, corner-button interface. Instead of tapping a ...
