Microsoft today launched a new app called Seeing AI, which the company describes as a talking camera for people who are visually impaired. The app uses artificial intelligence and the camera of an iPhone or iPad to describe the world around it. It's able to recognize text, objects, and people.


The app turns the visual world into an audible experience and using it is as simple as pointing the camera at various objects and people. The app can recognize saved friends, or describe people based on their approximate age and demeanor, and it can read text that it detects aloud.

Seeing AI can scan and read documents like books and letters, helping with formatting, and it can see objects like money to identify specific denominations. Within stores, it can scan barcodes to help users shop, and it's also able to be used within other apps like Twitter for evaluating images.

An experimental "Scenes" feature is available, allowing the app to analyze what's going on in a photograph. Scenes isn't perfect, and Seeing AI is an ongoing research product, so it may not accurately describe every image.


Seeing AI is available in the U.S., Canada, India, Hong Kong, New Zealand, Singapore starting today, with Microsoft planning to expand it to additional countries in the future. It works on the iPhone 5c and later, but performs best on the iPhone 6s and later.

Seeing AI can be downloaded from the App Store for free. [Direct Link]

Top Rated Comments

AppleGuesser Avatar
48 months ago
This is cool. Technology being used to make a persons life better, more productive, that’s the dream and goal. Bravo Microsoft for attempting this, knowing this is the first of many long steps.
Score: 12 Votes (Like | Disagree)
WRChris Avatar
48 months ago
seems like they're releasing all of this tech before the iphone 8 just so that they can say they did something first (incase the iphone does something similar)
Microsoft has been working on this for a very long time. They showed it at e3 this year. I think this is more about making the lives of blind people easier, not to be the first.

This software is severely limited by current battery tech.
Score: 9 Votes (Like | Disagree)
btrach144 Avatar
48 months ago
I believe I read somewhere that two of Satya's children have disabilities. Could explain why Microsoft is pushing accessibility so hard (everyone should be in my opinion). Good for Microsoft.
Score: 6 Votes (Like | Disagree)
WRChris Avatar
48 months ago
I believe I read somewhere that two of Satya's children have disabilities. Could explain why Microsoft is pushing accessibility so hard (everyone should be in my opinion). Good for Microsoft.
The guy they had at e3, who said he was leading the project, was blind. I thought it was pretty darn awesome too!
Score: 4 Votes (Like | Disagree)

Top Stories

apple transfer google photos 1

Apple Launches Service for Transferring iCloud Photos and Videos to Google Photos

Wednesday March 3, 2021 12:04 pm PST by
Apple this week introduced a new service that's designed to make it quick and easy for iCloud users to transfer their stored photos and videos to Google Photos. As outlined in an Apple support document, you can go to Apple's privacy website and sign in to see the "Transfer a copy of your data" option. If you select this and go through all the steps, Apple will transfer your iCloud photos and ...
rosetta 2

Rosetta May Be Removed From M1 Macs in Some Regions on macOS 11.3

Tuesday March 2, 2021 5:20 pm PST by
Installing the upcoming macOS 11.3 software update on an M1 Mac may result in Rosetta 2 being removed in one or more regions around the world. In the third beta of macOS 11.3 seeded to developers for testing today, MacRumors contributor Steve Moser uncovered new strings in the beta's code indicating that "Rosetta will be removed upon installing this update." Another new string reads "Rosetta ...
Screen Shot 2021 03 03 at 11

MagSafe Charging Port for iPhone Appears in Apple Patent

Wednesday March 3, 2021 1:30 am PST by
In a newly granted patent, Apple envisions a type of connectivity port using an iteration of its magnetic MagSafe charger to charge an iPhone, potentially paving the way for a future without Lightning. Submitted to the United States Patent and Trademark Office on Tuesday (via Patently Apple), the patent outlines a three-pinned MagSafe charger, similar to the ones found in older MacBook...
Oled iPads and MackBook Pro

OLED 10.9-Inch iPad Rumored for Early 2022, 12.9-Inch iPad Pro and 16-Inch MacBook Pro Could Follow

Thursday March 4, 2021 8:37 pm PST by
Earlier today, DigiTimes shared a preview of an upcoming report claiming that Apple is working on both iPad and Mac notebook models with OLED displays that could launch starting in 2022. The full report from DigiTimes is now available, and it includes several new alleged details about Apple's plans. According to the report, the first of these devices to adopt an OLED display is likely to be...
OLED iPad Pro and MacBook Pro

iPad and MacBook Models With OLED Displays Rumored to Launch in 2022

Thursday March 4, 2021 8:19 am PST by
Apple plans to release new iPad and MacBook models with OLED displays in 2022, according to industry sources cited by Taiwanese supply chain publication DigiTimes. The information was shared in the site's paywalled "Before Going to Press" section, so there are no further details yet, but the full report should be released by tomorrow. Apple has gradually increased its adoption of OLED...
iPad mini pro feature

Sketchy Rumor Claims 'iPad Mini Pro' Launching in Second Half of 2021

Wednesday March 3, 2021 3:04 am PST by
Apple is expected to launch a sixth-generation iPad mini in the first half of 2021, possibly as soon as this March, based on long-standing rumors. However, a new rumor out of Asia that has gained traction in the last 24 hours suggests an "iPad mini Pro" will arrive in the second half of this year. According to a post on Korean blog Naver, whose rumor track record is unknown, the device...
maxresdefault

What's on Your iPhone Home Screen?

Thursday March 4, 2021 10:31 am PST by
Over on our YouTube channel, MacRumors videographer Dan has a new video up where he shares his Home Screen, wallpaper, and all of his current favorite widgets. Subscribe to the MacRumors YouTube channel for more videos. Check out Dan's video to see his setup, and then comment below and show us your own Home Screens. It's always fun to see other peoples' Home Screens, and with widgets and...
apple pencil 3 leak

New Apple Pencil Allegedly Leaks With Glossy Finish and Redesigned Tip

Wednesday March 3, 2021 6:17 am PST by
Images supposedly depicting a third-generation Apple Pencil have been shared on Twitter by the leaker known as "Mr. White." The purported new Apple Pencil appears to share a very similar design to the current, second-generation Apple Pencil, which is shorter than the previous version and charges inductively on the side of an iPad. The updated Apple Pencil appears to have a glossy...
apple watch ecg wrist

Apple Watch ECG Feature Gets Approved in Australia

Wednesday March 3, 2021 2:07 am PST by
The Australian government has approved ECG functionality on the Apple Watch, giving Apple the all-clear to launch the feature for Apple Watch users in the country, according to a regulatory document first spotted by The 8-Bit. Earlier last month, the Apple Watch's irregular heart rhythm notification received approval in Australia, although ECG did not. Irregular heart rhythm is a feature...
PIA23764 RoverNamePlateonMars web

NASA Mars Perseverance Rover Uses Same PowerPC Chipset Found in 1998 G3 iMac

Tuesday March 2, 2021 3:21 am PST by
NASA's Perseverance rover, which recently made history landing on the surface of Mars, is powered by the same processor used in an iMac more than 23 years old. Image Credit: NASA As reported by NewScientist (via Gizmodo), the rover includes the PowerPC 750 processor, the same chip used in the G3 iMac in 1998. The main chipset is the same; however, there are differences between the...