Apple's Big Push to Improve Accessibility in iOS 13, iPadOS, and macOS Catalina

Apple is introducing several accessibility-friendly features with iOS 13, iPadOS, and macOS Catalina, including Voice Control, Hover Text, and Mouse Pointer Support for iPhones and iPads.

After the company's WWDC keynote on Monday, TechCrunch's iOS accessibility expert Steven Aquino sat down with Apple's Sarah Herrlinger, director of Global Accessibility Policy & Initiatives, who offered further details on the thinking behind Apple's latest, and arguably greatest, accessibility push.

Apple accessibility

Voice Control

Herrlinger first opened up about Apple's new Voice Control feature, which earned its own slide space during Craig Federighi’s onstage presentation. Voice Control supports editing and menu navigation in both macOS Catalina and iOS 13, but it was the feature's advanced dictation capabilities that Herrlinger was most eager to highlight.

For example, Herrlinger explained how you can say "show numbers" in Safari's Favorites view and little numbers, corresponding to the number of favorites you have, show up beside a website's favicon. Say TechCrunch is No. 2 in your list of favorites. If the glyph is hard to make out visually, saying "open 2" will prompt Voice Control to launch TechCrunch's page. Likewise, you can say "show grid" and a grid will appear so you perform actions such as clicking, tapping or pinching-and-zooming.

Herrlinger said Apple has worked hard to improve Voice Control's speech detection system, so that it can more adeptly parse users with different types of speech, such as those who stutter.

On iOS, the feature also utilizes attention awareness to know when a user with physical motor limitations is interacting with their device. Allaying privacy concerns, Apple says that none of the audio processed by Voice Control can be accessed by anyone else, including Apple, thanks to built-in anonymity and encryption.

Hover Text for macOS

Another feature Herrlinger was keen to demo was something called Hover Text on macOS. Described as a subset of the existing Zoom functionality, Hover Text enables the user to place the mouse pointer over a selection of text to get a bubble with the text enlarged.

Herrlinger told me the feature works system-wide, even in places like the menu bar. And yes, Hover Text is indeed customizable; users have access to a wide variety of fonts and colors to make Hover Text's "bubbles" their own. Text size can be enlarged up to 128pt, Herrlinger said. What this means is users can play with different permutations of the feature to find which label(s) work best — say, a yellow background with dark blue text set in Helvetica for the highest contrast. The possibilities are virtually endless, a testament to how rich the feature is despite its simplicity.

According to Herrlinger, Apple could have brought iOS feature Dynamic Type to the Mac, but found Hover Text accomplished the same goal of enlarging text in a way that felt better suited to its desktop operating system.

Mouse Support for iPhone and iPad

iPadOS and iOS 13 introduces mouse support for the first time, allowing a USB mouse to be connected to an iPad and iPhone for the first time.

Mouse support is not a standard feature, but is instead available as an AssistiveTouch option, designed for users with physical motor delays who can’t easily interact with the touchscreen itself. Apple says it works with both USB and Bluetooth mice, although the company doesn’t yet have an official compatibility list. According to developer Steve Troughton-Smith, who first discovered the feature, it also works with the Apple Magic Trackpad.

When I asked why build pointer support into a touch-based operating system, Herrlinger was unequivocal in her answer: it serves a need in the accessibility community. "This is not your old desktop cursor as the primary input method," she said.

The reality is, it's not your secondary choice, either. The bottom line is that, while Apple loves the idea of accessibility features being adopted by the mainstream, pointer support in iOS 13 and iPadOS really isn't the conventional PC input mechanism at all. In this case, it's a niche feature that should suit a niche use case; it's not supposed to represent the milestone of ‌iPad‌'s productivity growth that many think it could be. Maybe that changes over time, but for now, it's the new Mac Pro of software: not for everyone, not even for most people.

According to Herrlinger, Apple recognizes that people without disabilities will use this feature. "For example, many people find value in closed captions," she said. "Our goal is to engineer for specific use cases so that we continue to bring the power of our devices to more people."


That being said, Herrlinger was quick to emphasize that mouse support should be seen in context. In other words, Apple hasn't introduced it to drastically alter the primary user input landscape of iOS, although that being said, it's not going to stop anyone outside its intended use case from plugging a mouse into their iPad Pro.

iOS 13, iPadOS, and macOS Catalina are only available to registered developers at this time, but later in the summer, Apple plans to make public betas available, giving public beta testers a chance to try the software before it sees a public launch in the fall.

Related Forum: iOS 13

Top Rated Comments

Aston441 Avatar
25 months ago
Why are you dragging your feet Apple? Just make it a regular mouse cursor, like it was figured out to be, by Xerox, decades ago, to be one of the fastest and most comfortable ways to interact with a computer.

Just stop being weird.

You're going to add it eventually and we all know it. Just paste in the code.

Jerks.

I can't believe a closed, locked down OS became the most popular again.

Have we learned nothing from the Windows debacle? Apple is behaving worse than Microsoft ever did.
Score: 9 Votes (Like | Disagree)
Macaholic868 Avatar
25 months ago
I absolutely love this feature!!! The one thing that prevents me from going on vacation with an iPad alone leaving my laptop behind is that I need to be able to use Microsoft’s RD client to connect to my system at the office and do work that requires a mouse from time to time.

I can bumble my way through it with touch if it’s just adjusting a line or two of code but anything more than that and forget it on anything but a laptop or desktop with a mouse.

With mouse support I can take my iPad Pro with me and be safe in the knowledge that I’m covered if I have to do something more complex on my work PC that requires the precision of a mouse instead of touch through the RD interface! For me this one is a game changer!!!
Score: 5 Votes (Like | Disagree)
Khedron Avatar
25 months ago
Embarrassing that it took them this long. This is just a software switch to stop intentionally crippling standard bluetooth/USB interfaces.
Score: 3 Votes (Like | Disagree)
Darth Tulhu Avatar
25 months ago
I hope this works as we EXPECT IT TO, not some cockamamie Apple-exclusive-convoluted-three-finger-swipe-down-left-right-A-B-Start kind of way.
Score: 3 Votes (Like | Disagree)
mi7chy Avatar
25 months ago
What is the motive for hiding ordinary features like mouse support under accessibility? Is it because of shame for backtracking, playing into the hearts of consumers that they really care about disabilities, weird rebranding, etc.? No other mouse supported OS does this.
Score: 3 Votes (Like | Disagree)
Glideslope Avatar
25 months ago
Finally some innovation. :apple:
Score: 2 Votes (Like | Disagree)

Top Stories

tracking disabled ios 14 5

Analytics Suggest 96% of Users Leave App Tracking Disabled in iOS 14.5

Friday May 7, 2021 1:51 am PDT by
An early look at an ongoing analysis of Apple's App Tracking Transparency suggests that the vast majority of iPhone users are leaving app tracking disabled since the feature went live on April 26 with the release of iOS 14.5. According to the latest data from analytics firm Flurry, just 4% of iPhone users in the U.S. have actively chosen to opt into app tracking after updating their device...
macbook colors 3d black bezels

Prosser: Next MacBook Air Could Come in Colors Similar to iMac

Friday May 7, 2021 6:55 am PDT by
According to Apple leaker Jon Prosser, Apple's upcoming release of the MacBook Air will feature various colors, similar to the colors in the newly released 24-inch iMac. In the latest video of his YouTube channel Front Page Tech, Prosser says the same source who accurately provided him information on the first Apple silicon iMac coming in colors has told him that he recently saw a prototype...
tile amazon sidewalk integration

Tile to Leverage Amazon Echo and Ring Devices to Better Compete With AirTags

Friday May 7, 2021 2:07 pm PDT by
Amazon today announced that it is teaming up with Tile to add Amazon Sidewalk integration to Tile's Bluetooth trackers. Amazon Sidewalk, for those unfamiliar, is a network of Amazon Bluetooth devices that's designed to improve the connectivity of devices like the Ring and Amazon Echo. Tile will now be joining Amazon Sidewalk, and through this integration, Amazon Echo and Ring devices will be ...
Top Stories 59 Feature

Top Stories: Epic Games vs. Apple, Hidden AirTag Mode, Apple Music Hi-Fi, Colorful MacBook Air?

Saturday May 8, 2021 6:00 am PDT by
While we wait for the newly introduced iMac, iPad Pro, and Apple TV models to launch later this month, this week saw the kickoff of the big Epic Games v. Apple trial, with lots of juicy tidbits coming out as the two sides make their arguments. This week also saw some rumors about a Hi-Fi tier for Apple Music, more biometric sensing capabilities for Apple Watch, and timing for the...
zoom app icon

Apple Gave Zoom Access to Special API to Use iPad Camera During Split View Multitasking

Sunday May 9, 2021 2:00 am PDT by
Zoom, a hallmark platform used by millions during the global health crisis, has been given access to a special iPadOS API that allows the app to use the iPad camera while the app is in use in Split View multitasking mode. This case of special treatment was first brought to attention by app developer Jeremy Provost, who, in a blog post, explains that Zoom uses a special API that allows the...
snapchat dark mode

Snapchat Rolls Out Dark Mode on iOS

Wednesday May 5, 2021 1:17 am PDT by
Nearly two years following the release of iOS and iPadOS 13, which included native, built-in, and systemwide dark mode, Snapchat, one of the world's most prominent social media networks, has finally rolled out a dark mode theme for iOS users. Snapchat began testing a dark mode theme of its app design late last year with a small group of iOS users. Now, Snapchat says that as of this week, it...
tile sticker e1570533758981

Tile CEO: 'We Welcome Competition From Apple, But We Think It Needs to Be Fair'

Tuesday May 4, 2021 9:51 am PDT by
Just after Apple announced its AirTags, Tile CEO CJ Prober relayed his concerns about competing with Apple in the tracking space, and said that Tile would ask Congress to investigate Apple's business practices specific to Find My and item trackers. Prober this week did an interview with Bloomberg, where he further expanded on Tile's complaints about Apple and why he feels that Tile is...
fortnite apple logo 2

Epic CEO Tim Sweeney Admits App Store's 30% Cut Is Similar to Consoles, Would Have Accepted Special Deal With Apple

Tuesday May 4, 2021 1:54 pm PDT by
Apple's legal battle with Epic Games is continuing on, and during the second day of the trial, Epic Games' CEO Tim Sweeney continued his testimony against Apple. Sweeney was grilled by Apple's lawyers, and made several points seemingly favorable to Apple. In addition to mentioning how he prefers Apple's iPhone and values Apple's privacy policies that he's aiming to dismantle, Sweeney...
signal instagram ads3

Signal Shares the Instagram Ads Facebook Doesn't Want You to See

Wednesday May 5, 2021 1:29 am PDT by
Encrypted messaging app Signal has had a series of Instagram ads blocked from the social media platform, after it attempted to show users how much data the Facebook-owned company collects about them and how it's used to push targeted ads. In a blog post, Signal described how it generated the ads to show users why they were seeing them, simply by declaring upfront the information that the...
iphone 12 preorder purple

Apple Begins Transition to Randomized Serial Numbers With Purple iPhone 12

Wednesday May 5, 2021 9:17 am PDT by
MacRumors previously reported about Apple's plan to switch to randomized serial numbers for future products starting in early 2021, and this transition has now started with the new purple iPhone 12 model in multiple countries. With assistance from Aaron Zollo, host of the YouTube channel ZolloTech, we can confirm that the purple iPhone 12 released last month has a new 10-character serial...