Apple Expands Visual Intelligence With Bill Splitting, Nutrition Insights, and visionOS Support
Apple today unveiled significant upgrades to Visual Intelligence, including a new Siri mode in the Camera app that can analyze real-world objects and take actions directly from what the iPhone sees.
Apple's vice president of software engineering Sebastien Marineau-Mes detailed the enhancements during today's WWDC keynote, explaining that the new Siri mode in Camera uses image understanding powered by Apple's foundational models to interpret what the camera is pointed at and surface contextually relevant actions.
One of the headline use cases is bill splitting. Users can aim their iPhone camera at a restaurant check and immediately divide the total between friends, with Apple Cash integration allowing payments to be sent on the spot. Apple also demoed pointing the camera at a plate of food to receive nutritional insights.
Visual Intelligence is also coming to visionOS, bringing the same capability to Apple's spatial computing platform. Siri can recognize real-world objects in a user's environment and surface relevant information about them on demand.
Popular Stories
Apple today provided developers with the fifth beta of an upcoming visionOS 27 update for testing purposes, with the beta coming two weeks after Apple released the fourth beta.
visionOS 27 can be installed by opening the Settings app, going to Software Updates, and opting into Beta Updates.
visionOS 27 introduces Siri AI, the smarter and more capable version of Siri that's similar in...
Surgeons who wore an Apple Vision Pro as their primary display during a tear duct procedure finished operations 19% faster than surgeons using a traditional monitor, according to a peer-reviewed study by UC San Diego.
The study, published in the journal AJO International (via iPhone in Canada), looked at 32 endoscopic surgeries to clear blocked tear ducts. In half the cases, surgeons wore...
Apple and MLB today released the September schedule for Apple TV's weekly Friday Night Baseball doubleheader. The games are included with an Apple TV subscription at no additional cost, and there is a new perk for Vision Pro users.
For the first time, Friday Night Baseball will be streamed live in the Apple Immersive format, allowing Vision Pro users to watch a 3D video feed recorded in 8K...
