Apple Expands Visual Intelligence With Bill Splitting, Nutrition Insights, and visionOS Support
Apple today unveiled significant upgrades to Visual Intelligence, including a new Siri mode in the Camera app that can analyze real-world objects and take actions directly from what the iPhone sees.
Apple's vice president of software engineering Sebastien Marineau-Mes detailed the enhancements during today's WWDC keynote, explaining that the new Siri mode in Camera uses image understanding powered by Apple's foundational models to interpret what the camera is pointed at and surface contextually relevant actions.
One of the headline use cases is bill splitting. Users can aim their iPhone camera at a restaurant check and immediately divide the total between friends, with Apple Cash integration allowing payments to be sent on the spot. Apple also demoed pointing the camera at a plate of food to receive nutritional insights.
Visual Intelligence is also coming to visionOS, bringing the same capability to Apple's spatial computing platform. Siri can recognize real-world objects in a user's environment and surface relevant information about them on demand.
Popular Stories
Recent layoffs of Apple employees working on the Vision Pro were broader than previously thought, Bloomberg's Mark Gurman reports.
Last month, Gurman said that Apple cut around 100 jobs from the Vision Products Group, with those cuts centered on the headset's gaming and immersive video teams. Gurman now says the layoffs also reached Vision Pro staff across the rest of the company, including ...
In addition to cutting dozens of Vision Pro employees who worked on features like immersive video and gaming, Apple is laying off people who worked on Siri and AI, reports Bloomberg.
Apple is "largely shutting down" the Vision Pro team focused on gaming, and it is paring down the team that makes immersive video content. Approximately 100 employees who were part of the Vision Products Group...
Apple today provided developers with the eighth beta of an upcoming visionOS 27 update for testing purposes. The beta comes a week after Apple released the seventh beta.
visionOS 27 can be installed by opening the Settings app, going to Software Updates, and opting into Beta Updates.
visionOS 27 introduces Siri AI, the smarter and more capable version of Siri that's similar in capability ...
