On the eve of Windows’ 40th anniversary, tech giant Microsoft is embarking on a radical transformation of its desktop operating system. After officially saying goodbye to the older Windows 10, the company is deeply integrating artificial intelligence (AI) features into Windows 11. The biggest news is that users will not only be able to control their computers with their voice, but also have AI monitor what’s happening on the screen to perform complex tasks without human intervention!
The initiative is massive – AI features will be available on all supported Windows 11 PCs, not just the new Copilot Plus models. Voice control is activated with the command “Hey, Copilot!“, which has already been introduced.
Yousuf Mehdi, Microsoft’s executive vice president and chief marketing officer, categorically explained to The Verge: “We believe that voice will become a third way to control your computer. It is not intended to replace the keyboard and mouse, but it will be a rather significant additional feature and a new approach.“
In order for artificial intelligence to understand the context and what is happening in the digital environment, the user will have to consciously share their screen with it. This responsibility falls on the Copilot Vision feature, which Microsoft has been intensively testing in recent months. It is now available in all regions where Copilot works.
The application areas are wide and promising: AI will help with using applications, troubleshooting computer problems, exploring new features, and even be an assistant during games. Unlike Recall, which can run continuously in the background, Copilot Vision will launch only when needed.
The next logical step after understanding is action. The Copilot Actions feature will allow the AI assistant to perform actions directly on your computer. Microsoft will begin testing in preview channel, with initial usage scenarios limited.
The company warned that the AI agent may make mistakes or struggle with complex tasks at first. Therefore, only participants in the Copilot Labs program will have access initially.
Copilot will be deeply integrated into the Windows taskbar, allowing for quick activation of the new Vision and Voice features with just one click. In addition, Copilot will debut a revamped search engine that will be able to intelligently find not only online information, but also local files, applications, and settings on your computer. The era of voice control and contextual AI on desktops is now a fact.