Apple Vision Pro 'Visual Search' Feature Can Identify Items, Copy Printed Text, Translate and More

The Apple Vision Pro headset's visionOS operating system includes a feature called "Visual Search," which sounds like it is similar to the Visual Look Up feature on the iPhone and the iPad.

vision pro headset 1
With Visual Search, users can use the Vision Pro headset to get information about an item, detect and interact with text in the world around them, copy and paste printed text from the real world into apps, translate text between 17 different languages, and more.

Real world text that includes contact information, webpages, and unit conversions and similar information can be acted upon in ‌visionOS‌. So, for example, if a printed handout has a website link in it, you can scan the link with the Vision Pro, opening up a Safari window to view the website. Or, if a recipe calls for grams and you need ounces, you can convert using the headset.

Real-time text translation will also be useful for traveling and other instances when you might want to quickly translate what you're seeing in the real world. The ‌Apple Vision Pro‌ headset will be able to automatically detect text and documents, similar to how the ‌iPhone‌ can detect text in photos and allow it to be interacted with.

The Visual Search function was found in ‌visionOS‌ by Steve Moser. ‌visionOS‌ can be accessed through the latest Xcode beta at the moment, as Apple released the first version of the software earlier today.

Related Roundups: Apple Vision Pro, visionOS
Related Forum: Apple Vision Pro

Top Rated Comments

vegetassj4 Avatar
14 weeks ago

Excellent features but I have noticed things can get quite cluttered if you don’t stay on top of it.

Wait until they put in app ads on the thing....

Attachment Image
Score: 21 Votes (Like | Disagree)
appleguy123 Avatar
14 weeks ago
Cool af
Score: 17 Votes (Like | Disagree)
tripsync Avatar
14 weeks ago
it can even identify the missing digits in your bank account.
Score: 17 Votes (Like | Disagree)
tonywalker23 Avatar
14 weeks ago
I read a few pages today in the new Make Something Wonderful book by Jobs, and I got to the section about the 2001 first Apple Store. He is talking about the apple products but then mentions that they also had third party cameras, camcorders, digital organizers, and mp3 players… and naturally my mind thought about how my iPhone does all that (and tons more) in a relatively short time after the Apple Store first opened...

And I wonder, 5-10 years from now?, what will this thing look like, how slim will it get, will it replace the glasses I wear now and be just a few ounces and look like normal glasses? Seems crazy to even think that...

But considering that my first gen iPod I listen to led to my thin and powerful iPhone, and the iMac g4 on my home desk is archaic compared to my 11" super thin iPad Pro → I look fwd to what the future holds for this tech and the innovation that comes along with it.
Score: 11 Votes (Like | Disagree)
TimHalfCooked Avatar
14 weeks ago
Wonder if it will notice when I'm not wearing trousers and open the appropriate website?
Score: 11 Votes (Like | Disagree)
TheYayAreaLiving ?️ Avatar
14 weeks ago
Excellent features but I have noticed things can get quite cluttered if you don’t stay on top of it.

Attachment Image
Score: 10 Votes (Like | Disagree)

Popular Stories

iPhone 16 Mock Header With Dynamic Island

Skipping the iPhone 15 Pro? Here's What's Rumored for iPhone 16 Pro

Friday September 22, 2023 9:29 am PDT by
Are you skipping the iPhone 15 Pro and waiting another year to upgrade? If so, we already have some iPhone 16 Pro rumors for you. Below, we recap new features rumored for the iPhone 16 Pro models so far:Larger displays: The iPhone 16 Pro and iPhone 16 Pro Max will be equipped with larger 6.3-inch and 6.9-inch displays, respectively, according to Ross Young, CEO of Display Supply Chain...
Apple WWDC23 macOS Sonoma hero

macOS Sonoma Launching This Week With These New Features

Sunday September 24, 2023 12:45 pm PDT by
Apple previously announced that macOS Sonoma will be released this Tuesday, September 26. The free software update includes many new features and changes for the Mac, including the five that we have highlighted below. In addition to these five features, we have shared the full release notes for macOS Sonoma below for a complete overview of everything new. Desktop Widgets macOS Sonoma...
Apple Watch Ultra 2 double tap gesture 230912

watchOS 10.1 to Enable Apple Watch's New 'Double Tap' Gesture

Thursday September 21, 2023 12:52 pm PDT by
The new Double Tap gesture for the Apple Watch Series 9 and the Apple Watch Ultra 2 will be enabled starting with watchOS 10.1, according to Marques Brownlee, host of the popular tech-focused YouTube channel MKBHD. The first beta of watchOS 10.1 will likely be available by next week, and Apple announced that the software update will be released next month. Brownlee shared his impressions...