Apple Previews iOS 17 Accessibility Features Ahead of WWDC

Apple today previewed a wide range of new accessibility features for the iPhone, iPad, and Mac that are set to arrive later this year.

Apple accessibility iPad iPhone 14 Pro Max Home Screen
Apple says that the "new software features for cognitive, speech, and vision accessibility are coming later this year," which strongly suggests that they will be part of iOS 17, iPadOS 17, and macOS 14. The new operating systems are expected to be previewed at WWDC in early June before launching in the fall.

Assistive Access

Assistive Access distills ‌iPhone‌ and ‌iPad‌ apps and experiences to their core features. The mode includes a customized experience for Phone and FaceTime, which are combined into a single Calls app, as well as Messages, Camera, Photos, and Music. The feature offers a simplified interface with high contrast buttons and large text labels, as well as tools to help tailor the experience. For example, users can choose between a more visual, grid-based layout for their Home Screen and apps, or a row-based layout for users who prefer text.

assistive access mode apps

Live Speech and Personal Voice Advance Speech Accessibility

Live Speech on the ‌iPhone‌, ‌iPad‌, and Mac allows users to type what they want to say and have it spoken out loud during phone and ‌FaceTime‌ calls, as well as in-person conversations. Users can also save commonly used phrases to chime into conversations quickly.

live speech
Users at risk of losing their ability to speak, such as those with a recent diagnosis of amyotrophic lateral sclerosis (ALS), can use Personal Voice to create a digital voice that sounds like them. Users simply need to read along with a randomized set of text prompts to record 15 minutes of audio on an ‌iPhone‌ or ‌iPad‌. The feature uses on-device machine learning to keep users' information secure and private, and integrates with Live Speech so users can speak with their Personal Voice.

Detection Mode in Magnifier and Point and Speak

In the Magnifier app, Point and Speak helps users interact with physical objects that have several text labels. For example, while using a household appliance, Point and Speak combines input from the Camera app, the LiDAR Scanner, and on-device machine learning to announce the text on buttons as users move their finger across the keypad.

Point and Speak is built into the Magnifier app on ‌iPhone‌ and ‌iPad‌, works with VoiceOver, and can be used with other Magnifier features such as People Detection, Door Detection, and Image Descriptions to help users navigate their physical environment more effectively.

Other Features

  • Deaf or hard-of-hearing users can pair Made for ‌iPhone‌ hearing devices directly to a Mac with specific customization options.
  • Voice Control gains phonetic suggestions for text editing so users who type with their voice can choose the right word out of several that might sound similar, like "do," "due," and "dew."
  • Voice Control Guide helps users learn tips and tricks about using voice commands as an alternative to touch and typing.
  • Switch Control can now be activated to turn any switch into a virtual video game controller.
  • Text Size is now easier to adjust across Mac apps including Finder, Messages, Mail, Calendar, and Notes.
  • Users who are sensitive to rapid animations can automatically pause images with moving elements, such as GIFs, in Messages and Safari.
  • Users can customize the speed at which Siri speaks to them, with options ranging from 0.8x to 2x.
  • Shortcuts gains a new "Remember This" action, helping users with cognitive disabilities create a visual diary in the Notes app.
Related Roundups: iOS 17, iPadOS 17
Related Forums: iOS 17, iPadOS 17

Top Rated Comments

Candy Apple+ Nutz Avatar
12 months ago
Props for making things easier for those who need it.
Score: 32 Votes (Like | Disagree)
AirunJae Avatar
12 months ago
I really love to see Apple continuing its efforts on accessibility, great stuff.
Score: 25 Votes (Like | Disagree)
drumcat Avatar
12 months ago

I don't see what's the point of divulging them now when WWDC is less than a month away? Any ideas?
From the linked Apple site:

>
[HEADING=1]Celebrating Global Accessibility Awareness Day Around the World [/HEADING]
To celebrate Global Accessibility Awareness Day, this week Apple is introducing new features, curated collections, and more:
etc. etc.

Accessibility is a win for everyone. Once again, a heartfelt thanks to Apple for continuing to push this relentlessly. You never know when you'll need it.
Score: 20 Votes (Like | Disagree)
jamesarm97 Avatar
12 months ago
I can't wait, my wife is blind in one eye and half blind in the other due to a stroke from a violent assault. It is hard for her to see anything on the left since the vision is split in the brain. The larger icons, simplified interface would be a welcome relief I am sure.
Score: 18 Votes (Like | Disagree)
AirunJae Avatar
12 months ago

I don't see what's the point of divulging them now when WWDC is less than a month away? Any ideas?
Based on the fact that they released Final Cut Pro and Logic Pro for the iPad and now this? Sounds like it's going to be jam-packed and they're clearing the decks a bit.
Score: 16 Votes (Like | Disagree)
Lounge vibes 05 Avatar
12 months ago



Detection Mode in Magnifier and Point and Speak

In the Magnifier app, Point and Speak helps users interact with physical objets that have several text labels. For example, while using a household appliance, Point and Speak combines input from the Camera app, the LiDAR Scanner, and on-device machine learning to announce the text on buttons as users move their finger across the keypad.

Point and Speak is built into the Magnifier app on iPhone and iPad, works with VoiceOver, and can be used with other Magnifier features such as People Detection, Door Detection, and Image Descriptions to help users navigate their physical environment more effectively.

For those wondering when Apple is going to enter the AI game… It’s this. This is the kind of stuff Apple will and has been using AI and machine learning to create for years.
Not a silly false info littered essay writing machine, actual useful stuff that will help people who need it without vacuuming their data.
Score: 16 Votes (Like | Disagree)

Popular Stories

maxresdefault

Apple Announces 'Let Loose' Event on May 7 Amid Rumors of New iPads

Tuesday April 23, 2024 7:11 am PDT by
Apple has announced it will be holding a special event on Tuesday, May 7 at 7 a.m. Pacific Time (10 a.m. Eastern Time), with a live stream to be available on Apple.com and on YouTube as usual. The event invitation has a tagline of "Let Loose" and shows an artistic render of an Apple Pencil, suggesting that iPads will be a focus of the event. Subscribe to the MacRumors YouTube channel for more ...
Apple Silicon AI Optimized Feature Siri

Apple Releases Open Source AI Models That Run On-Device

Wednesday April 24, 2024 3:39 pm PDT by
Apple today released several open source large language models (LLMs) that are designed to run on-device rather than through cloud servers. Called OpenELM (Open-source Efficient Language Models), the LLMs are available on the Hugging Face Hub, a community for sharing AI code. As outlined in a white paper [PDF], there are eight total OpenELM models, four of which were pre-trained using the...
Apple Vision Pro Dual Loop Band Orange Feature 2

Apple Cuts Vision Pro Shipments as Demand Falls 'Sharply Beyond Expectations'

Tuesday April 23, 2024 9:44 am PDT by
Apple has dropped the number of Vision Pro units that it plans to ship in 2024, going from an expected 700 to 800k units to just 400k to 450k units, according to Apple analyst Ming-Chi Kuo. Orders have been scaled back before the Vision Pro has launched in markets outside of the United States, which Kuo says is a sign that demand in the U.S. has "fallen sharply beyond expectations." As a...
iPad And Calculator App Feature

Apple Finally Plans to Release a Calculator App for iPad Later This Year

Tuesday April 23, 2024 9:08 am PDT by
Apple is finally planning a Calculator app for the iPad, over 14 years after launching the device, according to a source familiar with the matter. iPadOS 18 will include a built-in Calculator app for all iPad models that are compatible with the software update, which is expected to be unveiled during the opening keynote of Apple's annual developers conference WWDC on June 10. AppleInsider...
iOS 18 Siri Integrated Feature

iOS 18 Rumored to Add These 10 New Features to Your iPhone

Wednesday April 24, 2024 2:05 pm PDT by
Apple is set to unveil iOS 18 during its WWDC keynote on June 10, so the software update is a little over six weeks away from being announced. Below, we recap rumored features and changes planned for the iPhone with iOS 18. iOS 18 will reportedly be the "biggest" update in the iPhone's history, with new ChatGPT-inspired generative AI features, a more customizable Home Screen, and much more....