Microsoft will test a Copilot AI feature that performs work on local files in Windows 11

On Tuesday, Microsoft officially ended support for Windows 10, which has been in use for a decade. In a strategic move to encourage users to upgrade to Windows 11, the tech giant is set to test a range of artificial intelligence functionalities. Participants in the Windows Insider Program and the Copilot Labs group will soon gain access to an enhanced Copilot assistant app capable of managing tasks using both desktop and web applications. This updated Copilot can handle various tasks, such as resizing images stored locally on users' devices. Users could command the assistant to compile a Spotify playlist featuring all available tracks by Brian Eno and initiate playback, according to Yusuf Mehdi, Microsoft's consumer marketing chief. This new feature aligns with similar AI capabilities developed by companies like Anthropic, Google, and OpenAI, which allow users to execute multi-step commands through computer-use agents. Previously, Microsoft has rolled out AI agents for corporate applications, and now, they are bringing this technology to consumers with premium subscriptions via a product known as Copilot Actions. Initially, this feature will be disabled by default but can be activated in a controlled environment, allowing users to observe the AI's operations in real-time. Users have the option to intervene whenever necessary, while the AI performs tasks in the background. Mehdi emphasized the importance of real-world testing, acknowledging that the AI might stumble with complicated commands. This phase is crucial for refining the technology further. Microsoft aims to capture the interest of users currently on Apple’s macOS or Google’s Chrome OS, especially as it reported a modest 2.5% increase in Windows and devices revenue, totaling $4.3 billion in the last quarter. Since its launch in 2021, Windows 11 has gradually gained traction, surpassing Windows 10 in popularity for the first time in July, according to Statcounter. By September, Microsoft held a 72% share of the operating system market. As Microsoft cautiously rolls out Copilot Actions, early access will be granted to Windows Insiders. The feature will only function within commonly used folders, such as desktop and documents, requiring user approval for broader data access. One exciting addition will be the ability to create websites directly from files using technology from Singaporean startup Manus. Moreover, Windows Insiders will soon be able to interact with Copilot's Vision feature through text chat, as opposed to voice commands alone. Microsoft is also introducing a redesigned shortcut for Copilot next to the Start button, featuring buttons for easy access to Copilot Vision and voice interactions. Users can simply say, "Hey Copilot" to summon the assistant effortlessly.