Microsoft: Copilot update makes AI more useful

Microsoft is distributing a new version of the Copilot app for Windows to Windows Insiders. Two new functions stand out in the software from the Microsoft Store: the “Highlights” function and support for two apps for data synchronization.

The functions require Microsoft's Copilot Vision – which is available in Microsoft Edge after logging in with an account or the Copilot Pro version. Copilot Vision can naturally answer spoken questions using voice recognition. When using Copilot Vision, the AI function can see the browser window or an app window. This allows Copilot to guide users or help them navigate or complete a specific task – with the new “Highlights” function, the AI can even show the user where to click. Highlights work with a single app, not several at the same time.

In the Copilot session, interested parties can share windows or apps and interact with Copilot on them. For example, Microsoft mentions the option of sharing the settings window and asking Copilot: “Show me how to switch on the night light”. Another example is sharing the video editor app “Clipchamp”. The screenshot above shows how Copilot responds to the request “Show me how to start creating a video in Clipchamp”.

Data synchronization between apps with Copilot Vision

The new version of Copilot Vision can now also handle two shared apps at the same time. This allows the AI assistant to help with analysis, provide insights and answer questions across both apps. As an example, Microsoft states that Copilot can help with the use of a packing list app and an online list for a backpacking trip. The question “Is something missing from my packing list compared to the online list?” is intended to highlight the differences.

To use Copilot Vision, interested parties need to click on the glasses icon in the Composer. They then select the browser window or app they want to share. To stop sharing, simply click on “Stop” or the “X” field in the Composer.

The Copilot app includes the new functions from version 1.25044.92.0, which is distributed to Windows Insiders via the Microsoft Store. The Copilot Vision function is limited to the USA for now; in addition, not all Copilot users will receive it at the same time, but it will be distributed gradually. However, Microsoft is not discussing when it will be the EU's turn.

Microsoft is pushing ahead with its AI offensive again. With the update preview versions from the end of April, the company brought the AI assistant Recall back to Copilot+ PCs with a sufficiently fast NPU (Neural Processing Unit). However, the start of this is not due to be distributed in the European Union until later in the year.

(dmk)