Apple Previews New Door Detection, Apple Watch Mirroring, and Live Captions Accessibility Features

Apple today previewed a range of new accessibility features, including Door Detection, Apple Watch Mirroring, Live Captions, and more.

Apple Accessibility OS features 2022
Door Detection will allow individuals who are blind or have low vision to use their iPhone or iPad to locate a door upon arriving at a new destination, understand how far they are from it, and describe the door's attributes, including how it can be opened and any nearby signs or symbols. The feature will be part of a new "Detection Mode" in Magnifier, alongside People Detection and Image Descriptions. Door Detection will only be available on iPhones and iPads with a LiDAR scanner.

Users with physical disabilities who may rely on Voice Control and Switch Control will be able to fully control their Apple Watch Series 6 and Apple Watch Series 7 from their ‌iPhone‌ with Apple Watch Mirroring via AirPlay, using assistive features like Voice Control and Switch Control, and inputs such as voice commands, sound actions, head tracking, and more.

New Quick Actions on the Apple Watch will allow users to use a double-pinch gesture to answer or end a phone call, dismiss a notification, take a photo, play or pause media in the Now Playing app, and start, pause, or resume a workout.

Deaf users and those who are hard of hearing will be able to follow Live Captions across the ‌iPhone‌, ‌iPad‌, and Mac, providing a way for users to follow any audio content more easily, such as during a phone call or when watching video content. Users can adjust the font size, see Live Captions for all participants in a group FaceTime call, and type responses that are spoken aloud. English Live Captions will be available in beta on the iPhone 11 and later, ‌iPad‌ models with the A12 Bionic and later, and Macs with Apple silicon later this year.

Apple will expand support for VoiceOver, its screen reader for blind and low vision users, with 20 new languages and locales, including Bengali, Bulgarian, Catalan, Ukrainian, and Vietnamese. In addition, users will be able to select from dozens of new optimized voices across languages and a new Text Checker tool to find formatting issues in text.

There will also be Sound Recognition for unique home doorbells and appliances, adjustable response times for Siri, new themes and customization options in Apple Books, and sound and haptic feedback for VoiceOver users in Apple Maps to find the starting point for walking directions.

The new accessibility features will be released later this year via software updates. For more information, see Apple's full press release.

To celebrate Global Accessibility Awareness Day, Apple also announced plans to launch SignTime in Canada on May 19 to support customers with American Sign Language (ASL) interpreters, launch live sessions in Apple Stores and social media posts to help users discover accessibility features, expand the Accessibility Assistant shortcut to the Mac and Apple Watch, highlight accessibility features in Apple Fitness+ such as Audio Hints, release a Park Access for All guide in ‌Apple Maps‌, and flag accessibility-focused content in the App Store, Apple Books, the TV app, and Apple Music.

Top Rated Comments

MikhailT Avatar
6 weeks ago

Apple again leads in accessibility. Love the Live captions and door detection.
To be fair, Android has this Live Captions feature already as well as Google Chrome. I had to rely on it on all platforms.

Microsoft announced and is testing Live Captions on Windows 11 insider builds for a few months now.

Apple is late as usual but I’m sure they will be the best implemented one as that is just them.

Regardless, everyone wins here. We need more accessibility support across the industry.
Score: 8 Votes (Like | Disagree)
NoGood@Usernames Avatar
6 weeks ago

I think the difference is that Google does all processing on their servers, Apple's implementation is on-device only and works offline. (not to mention your conversation stays private)
Actually, Google’s live caption is all done on-device and does not require an internet connection to function. They have been moving more and more voice request processing to on-device the past few years.
Score: 6 Votes (Like | Disagree)
iStorm Avatar
6 weeks ago

Actually, Google’s live caption is all done on-device and does not require an internet connection to function. They have been moving more and more voice request processing to on-device the past few years.
This is correct. Taken from Android Accessibility Help ('https://support.google.com/accessibility/android/answer/9350862?hl=en') page: "All captions are processed locally, never stored, and never leave your device."

When it comes to accessibility, users need anything that can help them now. They can't sit around and wait for something else, so I would say Apple is late to the game here. I know a co-worker who switched to Android several years ago so he could use the live caption feature for meetings. Previously, he was using a captioning service over the phone, but was not a fan of having another live person listening in on the meetings.
Score: 5 Votes (Like | Disagree)
Apple$ Avatar
6 weeks ago
Better late than never, Apple. As a CI Android user, I love the live captions feature so much! it's just so handy when you are watching a YouTube video that doesn't have captions. Instead of skipping it as I did in the past, I just turn on the live captions.
Score: 3 Votes (Like | Disagree)
eilavid Avatar
6 weeks ago

To be fair, Android has this Live Captions feature already as well as Google Chrome. I had to rely on it on all platforms.

Microsoft announced and is testing Live Captions on Windows 11 insider builds for a few months now.

Apple is late as usual but I’m sure they will be the best implemented one as that is just them.

Regardless, everyone wins here. We need more accessibility support across the industry.
I think the difference is that Google does all processing on their servers, Apple's implementation is on-device only and works offline. (not to mention your conversation stays private)
Score: 3 Votes (Like | Disagree)
surfzen21 Avatar
6 weeks ago

Apple again leads in accessibility. Love the Live captions and door detection.
Agreed. A lot of their accessibility features seem to get over looked but they actually are life-changing for folks in need.
Score: 3 Votes (Like | Disagree)

Related Stories

apple watch voip calling watchos 9

watchOS 9 Expands VoIP Calling on Apple Watch Beyond FaceTime Audio

Tuesday June 7, 2022 7:29 pm PDT by
Apple this week announced that watchOS 9 will allow users to make VoIP calls directly from an Apple Watch via supported third-party apps. During its WWDC 2022 keynote, Apple said that users will be able to start, end, or mute VoIP calls from the Apple Watch in supported apps like Webex. This feature will allow Apple Watch users to answer VoIP calls right from their wrist, and it is made...
apple watch abc action news

Apple Watch Saves Woman's Life With Feature She'd Never Heard Of

Wednesday March 23, 2022 1:59 am PDT by
An Apple Watch has been credited with saving a woman's life after it contacted emergency services when she fell, leading to a lung cancer diagnosis, ABC Action News reports. 71-year-old grandmother Raylene Hackenwerth, from Saint Petersburg, Florida, fell in early March, triggering her Apple Watch's Fall Detection feature. The Apple Watch's Fall Detection feature can tell when a wearer has...
wwdc 2022 live coverage

WWDC 2022 Apple Event Live Keynote Coverage: iOS 16, macOS 13, MacBook Air, and More

Monday June 6, 2022 9:08 am PDT by
Apple's Worldwide Developers Conference (WWDC) starts today with the traditional keynote kicking things off at 10:00 a.m. Pacific Time. We're expecting to see a number of announcements, including iOS 16, macOS 13, watchOS 9, and tvOS 16, though it's unclear what else we'll be seeing at the event. A redesigned MacBook Air tops the list of potential new hardware, but supply chain issues...
apple watch series 7 aluminum colors yellowbg

Deals: Get Up to $126 Off Apple Watch Series 7 and Apple Watch SE on Amazon

Friday June 24, 2022 5:04 am PDT by
Amazon today further discounted the 45mm Cellular Apple Watch Series 7, now available for $403.00, down from $529.00. Besides this model, you can also save on many other versions of the Apple Watch Series 7 along with the Apple Watch SE, all of which we've collected below. Note: MacRumors is an affiliate partner with Amazon. When you click a link and make a purchase, we may receive a small...
watchOS 9 Feature

Apple Seeds Second Beta of watchOS 9 to Developers

Wednesday June 22, 2022 10:06 am PDT by
Apple today seeded the second beta of an upcoming watchOS 9 update to developers for testing purposes, with the new beta coming two weeks after Apple unveiled the update at WWDC and provided the first beta to developers. To install ‌watchOS 9, developers will need to download the configuration profile from the Apple Developer Center. Once installed, ‌watchOS 8‌ can be downloaded...
apple watch quicktype

watchOS 9 Expands QuickType Keyboard Feature to Apple Watch Series 7

Tuesday June 7, 2022 10:13 am PDT by
Apple Watch Series 7 models feature larger displays compared to previous models, which allowed Apple to include a full on-screen keyboard that is exclusive to the Series 7. And now, watchOS 9 takes the keyboard a step further with a convenient new feature. As noted by tech analyst Brahm Shank, watchOS 9 expands QuickType to the Apple Watch Series 7, providing users with suggested words above ...
watchos 9 image

Apple Announces watchOS 9 With Updated Watch Faces, Enhanced Fitness and Sleep Tracking Features, More

Monday June 6, 2022 10:56 am PDT by
Apple today announced watchOS 9 for the Apple Watch, which will include more watch face options with more in-depth customization options, updates to notifications, new features in the Workout app, and more. Similar to iOS 16's new lock screen, the new watch faces in watchOS 9 let users personally style each face. There are four new faces: Lunar, Playtime, Metropolitan, and Astronomy; classic ...
macos ventura 1

Apple Introduces macOS Ventura: First Look at New Features

Monday June 6, 2022 11:18 am PDT by
Apple today announced the next version of macOS, called macOS Ventura, with several new features, including Stage Manager, Continuity Camera, new security updates, and more. Stage Manager helps you focus on the app you're using without any distractions by arranging all unused apps on the side, with the main and active app in the middle. Continuity Camera gives macOS users the ability to...

Popular Stories

2022 back to school apple

Apple Launches 2022 Back to School Offer: Up to $150 Gift Card With Mac or iPad

Friday June 24, 2022 5:08 am PDT by
Apple today launched its annual "Back to School" promotion for college/university students in the United States and Canada. This year's promotion offers a free Apple gift card with the purchase of an eligible Mac or iPad, rather than free AirPods like last year. Apple is also offering students 20% off AppleCare+ plans during the promotion. Apple is offering a $150 gift card with the purchase ...
airpods pro 2 1

AirPods Pro 2 Said to Feature Upgraded H1 Chip, Find My, Heart Rate Detection, USB-C and More

Friday June 24, 2022 9:48 am PDT by
The next-generation AirPods Pro could come with a long list of new features that include heart rate detection, the ability to function as a hearing aid, and a USB-C port according to a report from 52Audio. The site claims that it has received new information on the AirPods Pro 2, and it has used that information to provide some renders on what the earbuds might look like. Design wise, there...
m2 mac mini screen feature

Gurman: Apple Planning M2 Pro Mac Mini, New Apple TV With A14 Chip, Revamped HomePod With S8 Chip, and More

Sunday June 26, 2022 6:31 am PDT by
In the latest edition of his Power On newsletter for Bloomberg, Mark Gurman outlined additional M2 Macs on Apple's product roadmap, including new Mac mini models with M2 and M2 Pro chips, new 14-inch and 16-inch MacBook Pro models with M2 Pro and M2 Max chips, and a new Mac Pro tower with M2 Ultra and "M2 Extreme" chips. Following the M2 series of Macs, Gurman said the first M3 series of...
apple ar headset concept 1

Apple Rumored to Announce 'Game-Changer' AR/VR Headset in January 2023

Friday June 24, 2022 2:52 am PDT by
Apple is "likely" to announce its long-rumored mixed-reality headset as soon as January 2023, Apple analyst Ming-Chi Kuo has reiterated. Concept render based on purported leaked information by Ian Zelbo In a detailed post on Medium, Kuo explained that Apple's headset will be a "game-changer" for the augmented-reality and virtual-reality market. Describing some of the headset's...
widgets ios 16 feature

Gurman: iPhone 14 Pro to Feature Always-On Display Showing iOS 16's New Lock Screen Widgets

Sunday June 26, 2022 7:36 am PDT by
iPhone 14 Pro models are widely expected to feature always-on displays that allow users to view glanceable information without having to tap to wake the screen. In the latest edition of his Power On newsletter for Bloomberg, Mark Gurman said the feature will include support for iOS 16's new Lock screen widgets for weather, fitness, and more. "Like the Apple Watch, the iPhone 14 Pro will be...