Microsoft is expanding its Copilot Vision feature to Windows and mobile platforms, moving beyond its previous web-only functionality. Introduced as part of the Copilot redesign last year, Copilot Vision was initially confined to assist users on Edge webpages by providing contextual guidance.
With the latest update, Copilot Vision can now analyze real-time video captured from a mobile device’s camera. This enhancement enables the AI assistant to offer practical advice, such as tips for plant care or home decorating suggestions. Today, Microsoft is launching Copilot Vision within the Copilot app for both iOS and Android, with a similar feature set to be released on Windows shortly.
The Windows version of the Copilot app is being upgraded to integrate Copilot Vision across the entire PC ecosystem. This allows Microsoft’s AI assistant to guide users through utilizing various applications, such as Adobe Photoshop, or to analyze images and webpages that you are currently viewing.
This new capability differs from Microsoft’s Recall feature available on Copilot Plus PCs, which automatically captures snapshots when enabled. In contrast, Copilot Vision resembles the functionality of screen sharing during a Microsoft Teams call, allowing users to display an app or their entire desktop.
For Windows Insiders, Copilot Vision will be accessible next week, and Microsoft has indicated that a wider rollout will follow once testing concludes. Additionally, the company is introducing a variety of new features to Copilot today, which now includes support for memory, personalization, web-based actions, podcast creation, in-depth research, and more.
