Apple's Big Push to Improve Accessibility in iOS 13, iPadOS, and macOS Catalina

Apple is introducing several accessibility-friendly features with iOS 13, iPadOS, and macOS Catalina, including Voice Control, Hover Text, and Mouse Pointer Support for iPhones and iPads.

After the company's WWDC keynote on Monday, TechCrunch's iOS accessibility expert Steven Aquino sat down with Apple's Sarah Herrlinger, director of Global Accessibility Policy & Initiatives, who offered further details on the thinking behind Apple's latest, and arguably greatest, accessibility push.

Apple accessibility

Voice Control

Herrlinger first opened up about Apple's new Voice Control feature, which earned its own slide space during Craig Federighi’s onstage presentation. Voice Control supports editing and menu navigation in both macOS Catalina and iOS 13, but it was the feature's advanced dictation capabilities that Herrlinger was most eager to highlight.

For example, Herrlinger explained how you can say "show numbers" in Safari's Favorites view and little numbers, corresponding to the number of favorites you have, show up beside a website's favicon. Say TechCrunch is No. 2 in your list of favorites. If the glyph is hard to make out visually, saying "open 2" will prompt Voice Control to launch TechCrunch's page. Likewise, you can say "show grid" and a grid will appear so you perform actions such as clicking, tapping or pinching-and-zooming.

Herrlinger said Apple has worked hard to improve Voice Control's speech detection system, so that it can more adeptly parse users with different types of speech, such as those who stutter.

On iOS, the feature also utilizes attention awareness to know when a user with physical motor limitations is interacting with their device. Allaying privacy concerns, Apple says that none of the audio processed by Voice Control can be accessed by anyone else, including Apple, thanks to built-in anonymity and encryption.

Hover Text for macOS

Another feature Herrlinger was keen to demo was something called Hover Text on macOS. Described as a subset of the existing Zoom functionality, Hover Text enables the user to place the mouse pointer over a selection of text to get a bubble with the text enlarged.

Herrlinger told me the feature works system-wide, even in places like the menu bar. And yes, Hover Text is indeed customizable; users have access to a wide variety of fonts and colors to make Hover Text's "bubbles" their own. Text size can be enlarged up to 128pt, Herrlinger said. What this means is users can play with different permutations of the feature to find which label(s) work best — say, a yellow background with dark blue text set in Helvetica for the highest contrast. The possibilities are virtually endless, a testament to how rich the feature is despite its simplicity.

According to Herrlinger, Apple could have brought iOS feature Dynamic Type to the Mac, but found Hover Text accomplished the same goal of enlarging text in a way that felt better suited to its desktop operating system.

Mouse Support for iPhone and iPad

iPadOS and iOS 13 introduces mouse support for the first time, allowing a USB mouse to be connected to an iPad and iPhone for the first time.

Mouse support is not a standard feature, but is instead available as an AssistiveTouch option, designed for users with physical motor delays who can’t easily interact with the touchscreen itself. Apple says it works with both USB and Bluetooth mice, although the company doesn’t yet have an official compatibility list. According to developer Steve Troughton-Smith, who first discovered the feature, it also works with the Apple Magic Trackpad.

When I asked why build pointer support into a touch-based operating system, Herrlinger was unequivocal in her answer: it serves a need in the accessibility community. "This is not your old desktop cursor as the primary input method," she said.

The reality is, it's not your secondary choice, either. The bottom line is that, while Apple loves the idea of accessibility features being adopted by the mainstream, pointer support in iOS 13 and iPadOS really isn't the conventional PC input mechanism at all. In this case, it's a niche feature that should suit a niche use case; it's not supposed to represent the milestone of iPad's productivity growth that many think it could be. Maybe that changes over time, but for now, it's the new Mac Pro of software: not for everyone, not even for most people.

According to Herrlinger, Apple recognizes that people without disabilities will use this feature. "For example, many people find value in closed captions," she said. "Our goal is to engineer for specific use cases so that we continue to bring the power of our devices to more people."


That being said, Herrlinger was quick to emphasize that mouse support should be seen in context. In other words, Apple hasn't introduced it to drastically alter the primary user input landscape of iOS, although that being said, it's not going to stop anyone outside its intended use case from plugging a mouse into their iPad Pro.

iOS 13, iPadOS, and macOS Catalina are only available to registered developers at this time, but later in the summer, Apple plans to make public betas available, giving public beta testers a chance to try the software before it sees a public launch in the fall.

Related Forum: iOS 13

Top Rated Comments

Aston441 Avatar
34 months ago
Why are you dragging your feet Apple? Just make it a regular mouse cursor, like it was figured out to be, by Xerox, decades ago, to be one of the fastest and most comfortable ways to interact with a computer.

Just stop being weird.

You're going to add it eventually and we all know it. Just paste in the code.

Jerks.

I can't believe a closed, locked down OS became the most popular again.

Have we learned nothing from the Windows debacle? Apple is behaving worse than Microsoft ever did.
Score: 9 Votes (Like | Disagree)
Macaholic868 Avatar
34 months ago
I absolutely love this feature!!! The one thing that prevents me from going on vacation with an iPad alone leaving my laptop behind is that I need to be able to use Microsoft’s RD client to connect to my system at the office and do work that requires a mouse from time to time.

I can bumble my way through it with touch if it’s just adjusting a line or two of code but anything more than that and forget it on anything but a laptop or desktop with a mouse.

With mouse support I can take my iPad Pro with me and be safe in the knowledge that I’m covered if I have to do something more complex on my work PC that requires the precision of a mouse instead of touch through the RD interface! For me this one is a game changer!!!
Score: 5 Votes (Like | Disagree)
Khedron Avatar
34 months ago
Embarrassing that it took them this long. This is just a software switch to stop intentionally crippling standard bluetooth/USB interfaces.
Score: 3 Votes (Like | Disagree)
Darth Tulhu Avatar
34 months ago
I hope this works as we EXPECT IT TO, not some cockamamie Apple-exclusive-convoluted-three-finger-swipe-down-left-right-A-B-Start kind of way.
Score: 3 Votes (Like | Disagree)
mi7chy Avatar
34 months ago
What is the motive for hiding ordinary features like mouse support under accessibility? Is it because of shame for backtracking, playing into the hearts of consumers that they really care about disabilities, weird rebranding, etc.? No other mouse supported OS does this.
Score: 3 Votes (Like | Disagree)
Glideslope Avatar
34 months ago
Finally some innovation. :apple:
Score: 2 Votes (Like | Disagree)

Popular Stories

AirPods Pro Gen 3 Mock Feature Red

AirPods Pro 2 Could Start a New Accessory Ecosystem

Friday January 14, 2022 2:34 am PST by
Apple's second-generation AirPods Pro could arrive alongside a new series of accessories, recent leaked images suggest. Alleged leaked photos of the next-generation AirPods Pro obtained by MacRumors showed a charging case with a metal loop on the side for attaching a strap. Apple has not used this design for any of its other AirPod models and it is unclear why it would be added in this...
netflix2

Netflix Again Raises Prices for All Plans, 4K Streaming Now $20 Per Month

Friday January 14, 2022 12:46 pm PST by
Netflix today updated the prices for its streaming plans, and all of its offerings are now more expensive. The Basic plan is now priced at $9.99 per month, the Standard plan is priced at $15.49 per month, and the Premium plan is priced at $19.99 per month. The Basic plan is $1 more expensive, up from $8.99 per month. This plan allows users to watch on just one screen at a time, and it limits ...
iPhone 14 Mock pill and hole 16x9 120hz

Analyst: All iPhone 14 Models to Feature 120Hz Displays, 6GB of RAM, and More

Friday January 14, 2022 7:02 am PST by
Apple is rumored to announce four new iPhone 14 models in September, and ahead of time, analyst Jeff Pu has outlined his expectations for the devices. In a research note with Haitong International Securities, obtained by MacRumors, Pu claimed that all iPhone 14 models will feature ProMotion displays, compared to only Pro models currently. ProMotion enables a variable refresh rate up to 120Hz ...
ios 15

Apple Releases Minor iOS 15.2.1 and iPadOS 15.2.1 Updates

Wednesday January 12, 2022 10:05 am PST by
Apple today released minor 15.2.1 updates for iPhone and iPad users, and the software comes one month after Apple launched iOS 15.2 and iPadOS 15.2 with a slew of improvements. The iOS 15.2.1 and iPadOS 15.2.1 update can be downloaded for free and the software is available on all eligible devices over-the-air in the Settings app. To access the new software, go to Settings > General >...
maxresdefault

Hands-On With LG's 32-Inch UltraFine OLED Pro Display

Wednesday January 12, 2022 1:12 pm PST by
LG in December announced the launch of its new 2022 32-inch UltraFine OLED Pro display, and in our latest YouTube video, we went hands-on with it to see how it compares to Apple's Pro Display XDR and whether it might be worth picking up depending on the price point. Subscribe to the MacRumors YouTube channel for more videos. Officially named the "32BP95E," the display features a resolution of ...
iPad Pro Big Ol Logo Orange

Next iPad Pro Might Feature Large Glass Apple Logo to Allow Wireless Charging

Friday January 14, 2022 10:44 am PST by
Bloomberg's Mark Gurman and Debby Wu last year reported that Apple had tested a new iPad Pro with a glass back for wireless charging capabilities. In a recent edition of his newsletter, Gurman said he expects the new iPad Pro to be released in 2022. While the new iPad Pro is still on track to feature wireless charging, 9to5Mac's Filipe Espósito today reported that Apple may have ultimately...
iPhone 14 Mock pill and hole

iPhone 14 Pro Now Rumored to Feature Both Pill-Shaped and Circular Cutouts

Wednesday January 12, 2022 9:26 am PST by
Apple is widely expected to remove the notch on iPhone 14 Pro models, but there have been conflicting rumors about the new design. Early rumors suggested that Apple would adopt a hole-punch design with Face ID somehow moved completely under the display, and later it was rumored that there would be a pill-shaped cutout instead. Now, display industry consultant Ross Young has claimed that...
fortnite apple logo geforce feature

Fortnite Coming Back to iOS Soon Thanks to Nvidia's GeForce NOW Service

Thursday January 13, 2022 11:19 am PST by
With the Apple vs. Epic Games lawsuit continuing on, there are no signs that Apple has any intention of allowing popular battle royale game Fortnite to return to the App Store on iPhone and iPad. Epic Games has found a workaround though, by partnering up with Nvidia. GeForce NOW, Nvidia's streaming gaming service, will soon add Fortnite support, allowing Fortnite to be played through a...
iMac 27 inch 2020 sale

Deals: Apple's 21.5-Inch iMac Hits Record Low Price of $599.99 ($499 Off) [Update: Out of Stock]

Thursday January 13, 2022 4:05 am PST by
Amazon today has a great deal on the 2017 Intel 21.5-inch iMac (2.3GHz, 8GB RAM, 256GB SSD), priced at $599.99, down from $1,099.00. This is the best price we've ever tracked on this model, and it's only available at Amazon. The sale price will be reflected after an automatic coupon is applied at checkout. Note: MacRumors is an affiliate partner with some of these vendors. When you click a...