iOS 26: Visual Intelligence Now Searches On-Screen Content
Apple has announced a major Visual Intelligence update at WWDC 2025, enabling users to search and take action on anything displayed across their iPhone apps.
The feature, which previously worked only with the camera to identify real-world objects, now analyzes on-screen content. Users can ask ChatGPT questions about what they're viewing or search Google, Etsy, and other supported apps for similar items and products.
Visual Intelligence recognizes specific objects within apps – like highlighting a lamp to find similar items online. The system also detects events on screen and suggests adding them to Calendar, automatically extracting dates, times, and locations.
Accessing the feature appears straightforward: users press the same button combination used for screenshots. They can then choose to save or share the screenshot, or explore further with Visual Intelligence.
The update basically makes Visual Intelligence more of a universal search and action tool across the entire iPhone experience. Apple says the feature builds on Apple Intelligence's on-device processing approach, maintaining user privacy while delivering contextual assistance across apps.
Popular Stories
Apple today unveiled significant upgrades to Visual Intelligence, including a new Siri mode in the Camera app that can analyze real-world objects and take actions directly from what the iPhone sees.
Apple's vice president of software engineering Sebastien Marineau-Mes detailed the enhancements during today's WWDC keynote, explaining that the new Siri mode in Camera uses image understanding...
Apple's annual WWDC developers conference is drawing to a close, but there is still a lot to look forward to in the second half of the year.
Apple is expected to release at least 15 more products later this year. Now that the more intelligent and personal version of Siri has finally arrived in beta, a full two years after Apple first previewed it at WWDC 2024, we should begin to see some new ...
If you pay for extra iCloud storage on your iPhone, beyond the 5GB included for free, you might receive two more perks on iOS 27 at no additional cost.
First, Apple said there will be daily usage limits for some of the new and enhanced Apple Intelligence features on iOS 27, including image generation. However, the company noted that "increased access" is available with "most" iCloud+ storage ...
