Microsoft today launched a new app called Seeing AI, which the company describes as a talking camera for people who are visually impaired. The app uses artificial intelligence and the camera of an iPhone or iPad to describe the world around it. It's able to recognize text, objects, and people.


The app turns the visual world into an audible experience and using it is as simple as pointing the camera at various objects and people. The app can recognize saved friends, or describe people based on their approximate age and demeanor, and it can read text that it detects aloud.

Seeing AI can scan and read documents like books and letters, helping with formatting, and it can see objects like money to identify specific denominations. Within stores, it can scan barcodes to help users shop, and it's also able to be used within other apps like Twitter for evaluating images.

An experimental "Scenes" feature is available, allowing the app to analyze what's going on in a photograph. Scenes isn't perfect, and Seeing AI is an ongoing research product, so it may not accurately describe every image.


Seeing AI is available in the U.S., Canada, India, Hong Kong, New Zealand, Singapore starting today, with Microsoft planning to expand it to additional countries in the future. It works on the iPhone 5c and later, but performs best on the iPhone 6s and later.

Seeing AI can be downloaded from the App Store for free. [Direct Link]

Top Rated Comments

AppleGuesser Avatar
88 months ago
This is cool. Technology being used to make a persons life better, more productive, that’s the dream and goal. Bravo Microsoft for attempting this, knowing this is the first of many long steps.
Score: 12 Votes (Like | Disagree)
WRChris Avatar
88 months ago
seems like they're releasing all of this tech before the iphone 8 just so that they can say they did something first (incase the iphone does something similar)
Microsoft has been working on this for a very long time. They showed it at e3 this year. I think this is more about making the lives of blind people easier, not to be the first.

This software is severely limited by current battery tech.
Score: 9 Votes (Like | Disagree)
btrach144 Avatar
88 months ago
I believe I read somewhere that two of Satya's children have disabilities. Could explain why Microsoft is pushing accessibility so hard (everyone should be in my opinion). Good for Microsoft.
Score: 6 Votes (Like | Disagree)
WRChris Avatar
88 months ago
I believe I read somewhere that two of Satya's children have disabilities. Could explain why Microsoft is pushing accessibility so hard (everyone should be in my opinion). Good for Microsoft.
The guy they had at e3, who said he was leading the project, was blind. I thought it was pretty darn awesome too!
Score: 4 Votes (Like | Disagree)

Popular Stories

iPhone 16 Camera Lozenge 2 Colors

iPhone 16 Plus Rumored to Come in These 7 Colors

Wednesday April 10, 2024 3:52 am PDT by
Apple's iPhone 16 Plus may come in seven colors that either build upon the existing five colors in the standard iPhone 15 lineup or recast them in a new finish, based on a new rumor out of China. According to the Weibo-based leaker Fixed focus digital, Apple's upcoming larger 6.7-inch iPhone 16 Plus model will come in the following colors, compared to the colors currently available for the...
apple tv 4k yellow bg feature

When to Expect a New Apple TV to Launch

Tuesday April 9, 2024 8:30 am PDT by
It has been nearly a year and a half since the current Apple TV was released, so the device is becoming due for a hardware upgrade. Below, we recap rumors about the next Apple TV, including potential features and launch timing. The current model is the third-generation Apple TV 4K, announced in October 2022. Key new features compared to the previous model from 2021 include a faster A15...
apple silicon feature joeblue

Macs to Get AI-Focused M4 Chips Starting in Late 2024

Thursday April 11, 2024 10:10 am PDT by
Apple will begin updating its Mac lineup with M4 chips in late 2024, according to Bloomberg's Mark Gurman. The M4 chip will be focused on improving performance for artificial intelligence capabilities. Last year, Apple introduced the M3, M3 Pro, and M3 Max chips all at once in October, so it's possible we could see the M4 lineup come during the same time frame. Gurman says that the entire...
iOS 18 WWDC 24 Feature 2

iOS 18 May Feature All-New 'Safari Browsing Assistant'

Wednesday April 10, 2024 6:11 am PDT by
iOS 18 will apparently feature a new Safari browsing assistant, according to backend code on Apple's servers discovered by Nicolás Álvarez. MacRumors contributor Aaron Perris confirmed that the code exists, but not many details are known at this time. Álvarez said it seems like the browsing assistant will use iCloud Private Relay's infrastructure to send relevant data to Apple in a...
maxresdefault

Review: Six Months With the iPhone 15 Pro

Wednesday April 10, 2024 10:53 am PDT by
It's been a bit over six months since the iPhone 15 lineup came out in September, and MacRumors videographer Dan Barbera has been using an iPhone 15 Pro Max sans case since launch. Over on our YouTube channel, Dan did a long term review to demo how his phone has held up and his thoughts on the Action button, battery life, and camera features. Subscribe to the MacRumors YouTube channel for more ...
iPhone 16 Pro Sizes Feature

Alleged iPhone 16 Battery Details Show Smaller Capacity for One Model

Tuesday April 9, 2024 3:46 am PDT by
Apple's upcoming iPhone 16 lineup will feature bigger battery capacities compared to previous-generation models with the exception of the iPhone 16 Plus, which will have a smaller battery than its predecessor. That's according to the Chinese Weibo-based leaker OvO Baby Sauce OvO, a relatively new source of supply chain leaks with an as-yet unproven track record for accuracy. The iPhone 16 ...