Apple Previews New Door Detection, Apple Watch Mirroring, and Live Captions Accessibility Features

Apple today previewed a range of new accessibility features, including Door Detection, Apple Watch Mirroring, Live Captions, and more.

Apple Accessibility OS features 2022
Door Detection will allow individuals who are blind or have low vision to use their iPhone or iPad to locate a door upon arriving at a new destination, understand how far they are from it, and describe the door's attributes, including how it can be opened and any nearby signs or symbols. The feature will be part of a new "Detection Mode" in Magnifier, alongside People Detection and Image Descriptions. Door Detection will only be available on iPhones and iPads with a LiDAR scanner.

Users with physical disabilities who may rely on Voice Control and Switch Control will be able to fully control their Apple Watch Series 6 and Apple Watch Series 7 from their ‌iPhone‌ with Apple Watch Mirroring via AirPlay, using assistive features like Voice Control and Switch Control, and inputs such as voice commands, sound actions, head tracking, and more.

New Quick Actions on the Apple Watch will allow users to use a double-pinch gesture to answer or end a phone call, dismiss a notification, take a photo, play or pause media in the Now Playing app, and start, pause, or resume a workout.

Deaf users and those who are hard of hearing will be able to follow Live Captions across the ‌iPhone‌, ‌iPad‌, and Mac, providing a way for users to follow any audio content more easily, such as during a phone call or when watching video content. Users can adjust the font size, see Live Captions for all participants in a group FaceTime call, and type responses that are spoken aloud. English Live Captions will be available in beta on the iPhone 11 and later, ‌iPad‌ models with the A12 Bionic and later, and Macs with Apple silicon later this year.

Apple will expand support for VoiceOver, its screen reader for blind and low vision users, with 20 new languages and locales, including Bengali, Bulgarian, Catalan, Ukrainian, and Vietnamese. In addition, users will be able to select from dozens of new optimized voices across languages and a new Text Checker tool to find formatting issues in text.

There will also be Sound Recognition for unique home doorbells and appliances, adjustable response times for Siri, new themes and customization options in Apple Books, and sound and haptic feedback for VoiceOver users in Apple Maps to find the starting point for walking directions.

The new accessibility features will be released later this year via software updates. For more information, see Apple's full press release.

To celebrate Global Accessibility Awareness Day, Apple also announced plans to launch SignTime in Canada on May 19 to support customers with American Sign Language (ASL) interpreters, launch live sessions in Apple Stores and social media posts to help users discover accessibility features, expand the Accessibility Assistant shortcut to the Mac and Apple Watch, highlight accessibility features in Apple Fitness+ such as Audio Hints, release a Park Access for All guide in ‌Apple Maps‌, and flag accessibility-focused content in the App Store, Apple Books, the TV app, and Apple Music.

Top Rated Comments

MikhailT Avatar
13 weeks ago

Apple again leads in accessibility. Love the Live captions and door detection.
To be fair, Android has this Live Captions feature already as well as Google Chrome. I had to rely on it on all platforms.

Microsoft announced and is testing Live Captions on Windows 11 insider builds for a few months now.

Apple is late as usual but I’m sure they will be the best implemented one as that is just them.

Regardless, everyone wins here. We need more accessibility support across the industry.
Score: 8 Votes (Like | Disagree)
NoGood@Usernames Avatar
13 weeks ago

I think the difference is that Google does all processing on their servers, Apple's implementation is on-device only and works offline. (not to mention your conversation stays private)
Actually, Google’s live caption is all done on-device and does not require an internet connection to function. They have been moving more and more voice request processing to on-device the past few years.
Score: 6 Votes (Like | Disagree)
iStorm Avatar
13 weeks ago

Actually, Google’s live caption is all done on-device and does not require an internet connection to function. They have been moving more and more voice request processing to on-device the past few years.
This is correct. Taken from Android Accessibility Help ('https://support.google.com/accessibility/android/answer/9350862?hl=en') page: "All captions are processed locally, never stored, and never leave your device."

When it comes to accessibility, users need anything that can help them now. They can't sit around and wait for something else, so I would say Apple is late to the game here. I know a co-worker who switched to Android several years ago so he could use the live caption feature for meetings. Previously, he was using a captioning service over the phone, but was not a fan of having another live person listening in on the meetings.
Score: 5 Votes (Like | Disagree)
Apple$ Avatar
13 weeks ago
Better late than never, Apple. As a CI Android user, I love the live captions feature so much! it's just so handy when you are watching a YouTube video that doesn't have captions. Instead of skipping it as I did in the past, I just turn on the live captions.
Score: 3 Votes (Like | Disagree)
eilavid Avatar
13 weeks ago

To be fair, Android has this Live Captions feature already as well as Google Chrome. I had to rely on it on all platforms.

Microsoft announced and is testing Live Captions on Windows 11 insider builds for a few months now.

Apple is late as usual but I’m sure they will be the best implemented one as that is just them.

Regardless, everyone wins here. We need more accessibility support across the industry.
I think the difference is that Google does all processing on their servers, Apple's implementation is on-device only and works offline. (not to mention your conversation stays private)
Score: 3 Votes (Like | Disagree)
surfzen21 Avatar
13 weeks ago

Apple again leads in accessibility. Love the Live captions and door detection.
Agreed. A lot of their accessibility features seem to get over looked but they actually are life-changing for folks in need.
Score: 3 Votes (Like | Disagree)

Related Stories

apple watch series 7 titanium

Apple Watch Edition Begins Selling Out Ahead of Series 8 Launch

Tuesday August 2, 2022 7:55 am PDT by
Apple Watch Edition models are beginning to sell out just weeks before the Apple Watch Series 8 lineup is expected to be announced. Several of the high-end Apple Watch Series 7 models with titanium casings are listed as "currently unavailable" on Apple's online store in the United States, Canada, the United Kingdom, and select other countries. In the United States, availability of 41mm...
apple watch series 7 titanium

Titanium Apple Watch 'Pro' Could Signal the End of Apple Watch Edition

Monday July 25, 2022 8:30 am PDT by
The larger Apple Watch Series 8 model expected to arrive later this year is rumored to feature a titanium casing, raising questions about the future of the Apple Watch Edition. Yesterday, Bloomberg's Mark Gurman reported that the new, larger Apple Watch model scheduled to launch this year will feature a casing made of "a more durable formulation of titanium to make it extra rugged." Apple ...
Apple Watch Series 8 What We Know Feature

'Extreme Sports' Apple Watch With Larger Display, Metal Casing, and Longer Battery Life Coming in 2022

Wednesday July 6, 2022 1:25 pm PDT by
Apple is working on an "extreme sports" version of the Apple Watch that will feature a larger screen and a metal casing that's better able to stand up to abuse, according to Bloomberg's Mark Gurman. Aimed at athletes, hikers, and others who experience more extreme conditions when wearing their Apple Watches, the new device will be Apple's biggest to date. The display will measure in at...
Apple Watch Series 8 What We Know Feature 2

Only One Apple Watch Series 8 Model Rumored to Get Larger Battery

Friday July 15, 2022 2:31 am PDT by
Apple plans to release an Apple Watch Series 8 model with a larger battery this year, according to a recent report. Bloomberg's Mark Gurman believes that Apple is working on an "extreme sports" version of the Apple Watch that offers a larger display that is almost two-inches in size, improved impact resistance, and a larger battery. Gurman said that the larger battery could enable longer...
maxresdefault

Apple Promotes Durability of Apple Watch Series 7 in New 'Hard Knocks' Ad

Friday July 1, 2022 4:16 am PDT by
Apple today released a new ad for Apple Watch Series 7 highlighting the device's durability when exposed to various wearing conditions. In the ad titled "Hard Knocks," a number of scenarios are played out involving people either intentionally or accidentally exposing their Apple Watch to various weather conditions, liquids, and physical impacts. Some examples include someone diving into...
samsung watch 5 pro 91mobiles

Gurman: 'Apple Watch Pro' Extreme Sports Model Could Cost Nearly $1,000

Monday July 11, 2022 2:48 am PDT by
Apple's rumored high-end Apple Watch model for extreme sports could cost around $999 – the same starting price as the current iPhone 13 Pro – according to Bloomberg's Mark Gurman. Samsung Watch Pro 5, the likely rival of 'Apple Watch Pro' (Image: 91Mobiles) Writing in the latest edition of his Power On newsletter, Gurman compares the rumored premium watch to the current 45mm titanium Apple...
watchOS 9 Feature

Apple Seeds Fifth Beta of watchOS 9 to Developers

Monday August 8, 2022 10:12 am PDT by
Apple today seeded the fifth beta of an upcoming watchOS 9 update to developers for testing purposes, with the new beta coming a week and a half after Apple released the fourth beta to developers. To install ‌watchOS 9, developers will need to download the configuration profile from the Apple Developer Center. Once installed, ‌watchOS 8‌ can be downloaded through the dedicated Apple...
Apple Watch Series 7 Starlight Midnight

Standard Apple Watch Series 8 Rumored to Feature Same Design as Series 7

Friday August 5, 2022 7:46 am PDT by
The standard 41mm and 45mm models of the Apple Watch Series 8 will feature the same design as the Apple Watch Series 7, according to Twitter user @ShrimpApplePro, who was first to reveal that iPhone 14 Pro models would feature a new pill-and-hole display. Titanium will not be an option for the standard Apple Watch Series 8 models either, according to @ShrimpApplePro, but Bloomberg's Mark...

Popular Stories

iPhone 14 Dummies 1 Feature

Everything Rumored for Apple's September Event: iPhone 14, Apple Watch Pro and More

Friday August 12, 2022 2:34 pm PDT by
There's just about a month to go until Apple holds its annual September event focusing on new iPhone and Apple Watch models. We thought we'd take a quick look at everything that's rumored for Apple's September event to give MacRumors readers a rundown on what to expect when the first fall event rolls around. iPhone 14 The iPhone 14 can probably be described more as an "iPhone 13S" because...
iPhone 14 Pro Purple Rear Flat MacRumors Exclusive

iPhone 14 Pro Predicted to Start With Increased 256GB Storage Alongside Rumored Price Increase

Wednesday August 10, 2022 11:14 am PDT by
Earlier today, analyst Ming-Chi Kuo claimed iPhone 14 Pro models will be more expensive than iPhone 13 Pro models. Kuo did not reveal exact pricing, but he said that the average selling price of all four iPhone 14 models will increase by about 15% overall. While higher prices would be disappointing for customers, it is possible the iPhone 14 Pro and iPhone 14 Pro Max will offer increased...
iPhone 14 Pro Lineup Feature Silver

Kuo: Apple to Increase Prices of iPhone 14 Pro Models

Wednesday August 10, 2022 8:22 am PDT by
Apple plans to increase the prices of iPhone 14 Pro models compared to iPhone 13 Pro models, according to analyst Ming-Chi Kuo. Kuo did not reveal exact pricing for the iPhone 14 Pro models. However, in a tweet today, he estimated that the average selling price of the iPhone 14 lineup as a whole will increase by about 15% compared to the iPhone 13 lineup. In the United States, the iPhone...
iPhone 14 Pro Purple Front and Back MacRumors Exclusive feature

iPhone 14 Is Just a Few Weeks Away: Three Tips to Prepare for the New iPhone

Wednesday August 10, 2022 4:08 am PDT by
The launch of the new iPhone 14 is just a few weeks away, meaning millions of iPhone customers will soon upgrade their existing iPhone or perhaps get an iPhone for the first time. Exclusive MacRumors iPhone 14 Pro renders by graphic designer Ian Zelbo Whether upgrading from an older model or this is your first iPhone, we've rounded up a few tips to help you prepare for the next flagship...
z fold 4 1

Hands-On With Samsung's Latest Foldable Smartphones, the Galaxy Z Fold and Z Flip

Friday August 12, 2022 12:46 pm PDT by
Samsung this week launched its fourth-generation foldable devices, the $1,000 Galaxy Z Flip and the $1,800 Galaxy Z Fold. Though there's no sign of a comparable Apple foldable device on the horizon, rumors suggest prototypes are in the works, so we thought we'd take a look at Samsung's newest smartphones to see what Apple needs to measure up to when a foldable iPhone does come out. Subscribe ...
iPhone 14 Pro Purple Rear Flat MacRumors Exclusive

iPhone 14 Pro: Analyst Believes Storage Will Continue to Start at 128GB Despite Rumored Price Increase

Friday August 12, 2022 7:04 am PDT by
It wouldn't be the month before an iPhone launch without a few back-and-forth rumors, with the latest debate concerning iPhone 14 Pro storage. iPhone 14 Pro render by Ian Zelbo While research firm TrendForce forecasted that iPhone 14 Pro models could start with an increased 256GB of storage, Haitong International analyst Jeff Pu today forecasted that the upcoming Pro models will continue to...