Apple's Big Push to Improve Accessibility in iOS 13, iPadOS, and macOS Catalina

Apple is introducing several accessibility-friendly features with iOS 13, iPadOS, and macOS Catalina, including Voice Control, Hover Text, and Mouse Pointer Support for iPhones and iPads.

After the company's WWDC keynote on Monday, TechCrunch's iOS accessibility expert Steven Aquino sat down with Apple's Sarah Herrlinger, director of Global Accessibility Policy & Initiatives, who offered further details on the thinking behind Apple's latest, and arguably greatest, accessibility push.

Apple accessibility

Voice Control

Herrlinger first opened up about Apple's new Voice Control feature, which earned its own slide space during Craig Federighi’s onstage presentation. Voice Control supports editing and menu navigation in both macOS Catalina and iOS 13, but it was the feature's advanced dictation capabilities that Herrlinger was most eager to highlight.

For example, Herrlinger explained how you can say "show numbers" in Safari's Favorites view and little numbers, corresponding to the number of favorites you have, show up beside a website's favicon. Say TechCrunch is No. 2 in your list of favorites. If the glyph is hard to make out visually, saying "open 2" will prompt Voice Control to launch TechCrunch's page. Likewise, you can say "show grid" and a grid will appear so you perform actions such as clicking, tapping or pinching-and-zooming.

Herrlinger said Apple has worked hard to improve Voice Control's speech detection system, so that it can more adeptly parse users with different types of speech, such as those who stutter.

On iOS, the feature also utilizes attention awareness to know when a user with physical motor limitations is interacting with their device. Allaying privacy concerns, Apple says that none of the audio processed by Voice Control can be accessed by anyone else, including Apple, thanks to built-in anonymity and encryption.

Hover Text for macOS

Another feature Herrlinger was keen to demo was something called Hover Text on macOS. Described as a subset of the existing Zoom functionality, Hover Text enables the user to place the mouse pointer over a selection of text to get a bubble with the text enlarged.

Herrlinger told me the feature works system-wide, even in places like the menu bar. And yes, Hover Text is indeed customizable; users have access to a wide variety of fonts and colors to make Hover Text's "bubbles" their own. Text size can be enlarged up to 128pt, Herrlinger said. What this means is users can play with different permutations of the feature to find which label(s) work best — say, a yellow background with dark blue text set in Helvetica for the highest contrast. The possibilities are virtually endless, a testament to how rich the feature is despite its simplicity.

According to Herrlinger, Apple could have brought iOS feature Dynamic Type to the Mac, but found Hover Text accomplished the same goal of enlarging text in a way that felt better suited to its desktop operating system.

Mouse Support for iPhone and iPad

iPadOS and iOS 13 introduces mouse support for the first time, allowing a USB mouse to be connected to an iPad and iPhone for the first time.

Mouse support is not a standard feature, but is instead available as an AssistiveTouch option, designed for users with physical motor delays who can’t easily interact with the touchscreen itself. Apple says it works with both USB and Bluetooth mice, although the company doesn’t yet have an official compatibility list. According to developer Steve Troughton-Smith, who first discovered the feature, it also works with the Apple Magic Trackpad.

When I asked why build pointer support into a touch-based operating system, Herrlinger was unequivocal in her answer: it serves a need in the accessibility community. "This is not your old desktop cursor as the primary input method," she said.

The reality is, it's not your secondary choice, either. The bottom line is that, while Apple loves the idea of accessibility features being adopted by the mainstream, pointer support in iOS 13 and iPadOS really isn't the conventional PC input mechanism at all. In this case, it's a niche feature that should suit a niche use case; it's not supposed to represent the milestone of iPad's productivity growth that many think it could be. Maybe that changes over time, but for now, it's the new Mac Pro of software: not for everyone, not even for most people.

According to Herrlinger, Apple recognizes that people without disabilities will use this feature. "For example, many people find value in closed captions," she said. "Our goal is to engineer for specific use cases so that we continue to bring the power of our devices to more people."


That being said, Herrlinger was quick to emphasize that mouse support should be seen in context. In other words, Apple hasn't introduced it to drastically alter the primary user input landscape of iOS, although that being said, it's not going to stop anyone outside its intended use case from plugging a mouse into their iPad Pro.

iOS 13, iPadOS, and macOS Catalina are only available to registered developers at this time, but later in the summer, Apple plans to make public betas available, giving public beta testers a chance to try the software before it sees a public launch in the fall.

Related Forum: iOS 13

Top Rated Comments

Aston441 Avatar
30 months ago
Why are you dragging your feet Apple? Just make it a regular mouse cursor, like it was figured out to be, by Xerox, decades ago, to be one of the fastest and most comfortable ways to interact with a computer.

Just stop being weird.

You're going to add it eventually and we all know it. Just paste in the code.

Jerks.

I can't believe a closed, locked down OS became the most popular again.

Have we learned nothing from the Windows debacle? Apple is behaving worse than Microsoft ever did.
Score: 9 Votes (Like | Disagree)
Macaholic868 Avatar
30 months ago
I absolutely love this feature!!! The one thing that prevents me from going on vacation with an iPad alone leaving my laptop behind is that I need to be able to use Microsoft’s RD client to connect to my system at the office and do work that requires a mouse from time to time.

I can bumble my way through it with touch if it’s just adjusting a line or two of code but anything more than that and forget it on anything but a laptop or desktop with a mouse.

With mouse support I can take my iPad Pro with me and be safe in the knowledge that I’m covered if I have to do something more complex on my work PC that requires the precision of a mouse instead of touch through the RD interface! For me this one is a game changer!!!
Score: 5 Votes (Like | Disagree)
Khedron Avatar
30 months ago
Embarrassing that it took them this long. This is just a software switch to stop intentionally crippling standard bluetooth/USB interfaces.
Score: 3 Votes (Like | Disagree)
Darth Tulhu Avatar
30 months ago
I hope this works as we EXPECT IT TO, not some cockamamie Apple-exclusive-convoluted-three-finger-swipe-down-left-right-A-B-Start kind of way.
Score: 3 Votes (Like | Disagree)
mi7chy Avatar
30 months ago
What is the motive for hiding ordinary features like mouse support under accessibility? Is it because of shame for backtracking, playing into the hearts of consumers that they really care about disabilities, weird rebranding, etc.? No other mouse supported OS does this.
Score: 3 Votes (Like | Disagree)
Glideslope Avatar
30 months ago
Finally some innovation. :apple:
Score: 2 Votes (Like | Disagree)

Top Stories

iphone 12 colors 2021

iPhone 12 Colors: Deciding on The Right Color

Thursday November 5, 2020 8:35 am PST by
The iPhone 12 and iPhone 12 Pro arrived last October in a range of color options, with entirely new hues available on both devices, as well as some popular classics. The 12 and 12 Pro have different color choices, so if you have your heart set on a particular shade, you might not be able to get your preferred model in that color. iPhone 12 mini and iPhone 12 The iPhone 12 mini and iPhone 12...
original iphone

Phil Schiller Says iPhone Was 'Earth-Shattering' Ten Years Ago and Remains 'Unmatched' Today

Monday January 9, 2017 7:15 am PST by
To commemorate the tenth anniversary of the iPhone, Apple marketing chief Phil Schiller sat down with tech journalist Steven Levy for a wide-ranging interview about the smartphone's past, present, and future. The report first reflects upon the iPhone's lack of support for third-party apps in its first year. The argument inside Apple was split between whether the iPhone should be a closed...
iCloud General Feature

iCloud+'s New Custom Email Domain Feature Now Available in Beta

Wednesday August 25, 2021 7:48 am PDT by
Starting with iOS 15, iPadOS 15, and macOS Monterey, users with a paid iCloud+ storage plan can personalize their iCloud email address with a custom domain name, such as johnny@appleseed.com, and the feature is now available in beta. iCloud+ subscribers interested in setting up a custom email domain can visit the beta.icloud.com website, select "Account Settings" under their name, and select ...
iPhone 13 Dummy Thumbnail 2

Full iPhone 13 Feature Breakdown: Everything Rumors Say We Can Expect

Tuesday August 31, 2021 7:50 am PDT by
With the launch of Apple's iPhone 13 lineup believed to be just a few weeks away, we have compiled all of the coherent rumors from our coverage over the past year to build a full picture of the features and upgrades coming to the company's new smartphones. For clarity, only explicit improvements, upgrades, and new features compared to the iPhone 12 lineup are listed. It is worth noting that...
iPhone 13 Dummy Thumbnail 2

Kuo: iPhone 13 to Feature LEO Satellite Communications to Make Calls and Texts Without Cellular Coverage

Sunday August 29, 2021 7:39 am PDT by
The iPhone 13 will feature low earth orbit (LEO) satellite communication connectivity to allow users to make calls and send messages in areas without 4G or 5G coverage, according to the reliable analyst Ming-Chi Kuo. In a note to investors, seen by MacRumors, Kuo explained that the iPhone 13 lineup will feature hardware that is able to connect to LEO satellites. If enabled with the relevant...
macbook air deals

Deals: Amazon Drops Price of 256GB M1 MacBook Air to New Low of $849.99 ($149 Off)

Friday August 27, 2021 6:16 am PDT by
Amazon today introduced new low prices on the M1 MacBook Air for both 256GB and 512GB storage options. To start, you can get the 256GB model for $849.99, down from an original price of $999.00. Note: MacRumors is an affiliate partner with Amazon. When you click a link and make a purchase, we may receive a small payment, which helps us keep the site running. Only Silver and Gold are...
maxresdefault

New MacBook Pro Models Coming at WWDC, Suggests Leaker

Monday May 24, 2021 1:27 pm PDT by
New MacBook Pro models are coming at WWDC, according to leaker Jon Prosser who has a mixed track record when it comes to predicting Apple's plans. Subscribe to the MacRumors YouTube channel for more videos. Prosser provided no additional information, but there are new 14 and 16-inch MacBook Pro models in the works. The new MacBook Pros will feature the most radical redesign to the MacBook Pro ...
calculatorapp

iOS 11 Bug: Typing 1+2+3 Quickly in the Calculator App Won't Get You 6

Tuesday October 24, 2017 2:03 pm PDT by
A bug in the built-in Calculator app in iOS 11 is getting some major attention this week, despite the fact that it's been around since iOS 11 was in beta testing. At issue is a calculator animation that causes some symbols to be ignored when calculations are entered in rapid succession. You can try it for yourself: Type 1+2+3 and then the equals sign into the Calculator app quickly. Due to...
maxresdefault

'Being James Bond' Retrospective Will Be Free to Watch Through Apple TV App

Tuesday August 31, 2021 8:25 am PDT by
Update 9/7/21: "Being James Bond" is now available to watch through the Apple TV app. Ahead of the theatrical release of James Bond film "No Time To Die" on October 8 in the United States, a 45-minute retrospective titled "Being James Bond" will be available to watch for free through the Apple TV app, according to Deadline. The story from MGM is said to feature Daniel Craig reflecting ...
ted lasso notchless phone

No, That Notchless iPhone Spotted in 'Ted Lasso' Isn't the iPhone 13

Tuesday August 31, 2021 2:15 am PDT by
Recent sightings of a notchless iPhone in highly popular Apple TV+ comedy "Ted Lasso" have led to sensational headlines suggesting this is a canny bit of product placement on Apple's part and that the iPhone 13 will be notchless. In actuality – and this could go without saying – the phone in question is very likely just showing a poorly superimposed display added in post-production. Notchless ...