Apple Expands Visual Intelligence With Bill Splitting, Nutrition Insights, and visionOS Support
Apple today unveiled significant upgrades to Visual Intelligence, including a new Siri mode in the Camera app that can analyze real-world objects and take actions directly from what the iPhone sees.
Apple's vice president of software engineering Sebastien Marineau-Mes detailed the enhancements during today's WWDC keynote, explaining that the new Siri mode in Camera uses image understanding powered by Apple's foundational models to interpret what the camera is pointed at and surface contextually relevant actions.
One of the headline use cases is bill splitting. Users can aim their iPhone camera at a restaurant check and immediately divide the total between friends, with Apple Cash integration allowing payments to be sent on the spot. Apple also demoed pointing the camera at a plate of food to receive nutritional insights.
Visual Intelligence is also coming to visionOS, bringing the same capability to Apple's spatial computing platform. Siri can recognize real-world objects in a user's environment and surface relevant information about them on demand.
Popular Stories
Apple today provided developers with the second beta of an upcoming visionOS 27 update for testing purposes, with the beta coming two weeks after Apple released the first beta.
visionOS 27 can be installed by opening the Settings app, going to Software Updates, and opting into Beta Updates.
visionOS 27 introduces Siri AI, the smarter and more capable version of Siri that's similar in...
Apple today provided developers with the third betas of upcoming watchOS 26.6, tvOS 26.6, and visionOS 26.6 betas for testing purposes. The software comes two weeks after Apple seeded the second betas.
The software updates are available through the Settings app on each device, and because these are developer betas, a free developer account is required.
There's no word on what's in the...
The latest beta of Apple's Reality Composer Pro 3, the content creation tool used to build spatial experiences for Apple Vision Pro, appears to contain traces of "The Machinery," an ambitious game development project that abruptly shut down in 2022 without explanation.
Based on code discovered by Nicolás Alvarez and independently confirmed by MacRumors, binaries included with Reality...
