Apple Vision Pro 'Visual Search' Feature Can Identify Items, Copy Printed Text, Translate and More

The Apple Vision Pro headset's visionOS operating system includes a feature called "Visual Search," which sounds like it is similar to the Visual Look Up feature on the iPhone and the iPad.

vision pro headset 1
With Visual Search, users can use the Vision Pro headset to get information about an item, detect and interact with text in the world around them, copy and paste printed text from the real world into apps, translate text between 17 different languages, and more.

Real world text that includes contact information, webpages, and unit conversions and similar information can be acted upon in ‌visionOS‌. So, for example, if a printed handout has a website link in it, you can scan the link with the Vision Pro, opening up a Safari window to view the website. Or, if a recipe calls for grams and you need ounces, you can convert using the headset.

Real-time text translation will also be useful for traveling and other instances when you might want to quickly translate what you're seeing in the real world. The ‌Apple Vision Pro‌ headset will be able to automatically detect text and documents, similar to how the ‌iPhone‌ can detect text in photos and allow it to be interacted with.

The Visual Search function was found in ‌visionOS‌ by Steve Moser. ‌visionOS‌ can be accessed through the latest Xcode beta at the moment, as Apple released the first version of the software earlier today.

Related Roundups: Apple Vision Pro, visionOS
Buyer's Guide: Vision Pro (Buy Now)
Related Forum: Apple Vision Pro

Popular Stories

maxresdefault

iPhone SE 4 With Face ID Said to Be Priced Below $500

Monday May 20, 2024 3:43 am PDT by
Apple is targeting a sub-$500 starting price for its upcoming fourth-generation iPhone SE model despite a raft of rumored upgrades coming to the more affordable device. According to leaker Revegnus on X, the U.S. launch price of the fourth-generation iPhone SE will either remain at the same $429 starting price as the current model, or will see an increase of around 10%. Either way, Apple's...
iOS 17

Apple Releases iOS 17.5.1 With Fix for Reappearing Photos Bug

Monday May 20, 2024 10:11 am PDT by
Apple today released iOS 17.5.1 and iPadOS 17.5.1, minor updates to the iOS 17 and iPadOS 17 operating system updates that came out last September. The 17.5.1 updates come a week after the launch of iOS 17.5 and iPadOS 17.5. iOS 17.5.1 and iPadOS 17.5.1 can be downloaded on eligible iPhones and iPads over-the-air by going to Settings > General > Software Update. According to Apple's...
iPhone 16 Pro Max Generic Feature 2

5 Biggest Changes Rumored for iPhone 16 Pro Max

Tuesday May 21, 2024 7:29 am PDT by
Given Apple's rumored plan to add an all-new high-end tier to its iPhone 17 series in 2025, this could be the year for Apple to bring its boldest "Pro Max" model to the table — the kind of iPhone 16 upgrade that stands tall above its siblings, both figuratively and literally. If you have been holding out for the iPhone 16 Pro Max, here are five of the biggest changes rumored to be coming...
microsoft surface pro qualcomm

Microsoft Says New Surface Pro is Faster Than 15" M3 MacBook Air

Monday May 20, 2024 3:19 pm PDT by
Microsoft is going all in on AI, today introducing a series of Copilot+ PCs that have AI-focused hardware. The new Surface Pro is one of the first Copilot+ PCs, equipped with Qualcomm's Arm-based Snapdragon X Elite processor. Microsoft is already pitting the Surface Pro against Apple's M3 MacBook Air, and in marketing materials, claims that the Surface Pro has superior processing power and...
iPhone 16 Camera Lozenge 2 Perspective

iPhone 16 Lineup Rumored to Come in These Two New Colors

Sunday May 19, 2024 11:08 am PDT by
Apple analyst Ming-Chi Kuo today outlined his expectations for the iPhone 16 lineup's color options, revealing that two new colors should replace two of the existing shades. Kuo outlined his expectations in a post on X (formerly Twitter) earlier today. He believes that the iPhone 16 Pro and iPhone 16 Pro Max will be available in black, white or silver, gray or "Natural Titanium," and rose....

Top Rated Comments

vegetassj4 Avatar
12 months ago

Excellent features but I have noticed things can get quite cluttered if you don’t stay on top of it.


Wait until they put in app ads on the thing....



Attachment Image
Score: 21 Votes (Like | Disagree)
appleguy123 Avatar
12 months ago
Cool af
Score: 17 Votes (Like | Disagree)
tripsync Avatar
12 months ago
it can even identify the missing digits in your bank account.
Score: 17 Votes (Like | Disagree)
tonywalker23 Avatar
12 months ago
I read a few pages today in the new Make Something Wonderful book by Jobs, and I got to the section about the 2001 first Apple Store. He is talking about the apple products but then mentions that they also had third party cameras, camcorders, digital organizers, and mp3 players… and naturally my mind thought about how my iPhone does all that (and tons more) in a relatively short time after the Apple Store first opened...

And I wonder, 5-10 years from now?, what will this thing look like, how slim will it get, will it replace the glasses I wear now and be just a few ounces and look like normal glasses? Seems crazy to even think that...

But considering that my first gen iPod I listen to led to my thin and powerful iPhone, and the iMac g4 on my home desk is archaic compared to my 11" super thin iPad Pro → I look fwd to what the future holds for this tech and the innovation that comes along with it.
Score: 11 Votes (Like | Disagree)
TimHalfCooked Avatar
12 months ago
Wonder if it will notice when I'm not wearing trousers and open the appropriate website?
Score: 11 Votes (Like | Disagree)
TheYayAreaLiving ?️ Avatar
12 months ago
Excellent features but I have noticed things can get quite cluttered if you don’t stay on top of it.



Attachment Image
Score: 10 Votes (Like | Disagree)