Windows 11 Unleashes Powerful AI Features for Real-World Applications

Windows 11 Introduces AI Features for Real-World Use

Windows 11, the latest operating system from Microsoft, brings a host of AI capabilities that users can experience firsthand. With controversies surrounding OpenAI’s CEO, Microsoft has embraced generative artificial intelligence (genAI) as a key focus. While the next-generation Windows version with AI-based desktop interfaces is still in development, Windows 11 already incorporates AI in various forms. These AI features are gradually being rolled out to Windows PCs over time.

Copilot: AI Assistant

The most significant AI feature in Windows 11 is Copilot, an assistant powered by genAI. Through the Copilot sidebar, users can access a large-scale language model based on GPT 4 and integrated Bing search. Opening Copilot is as simple as clicking the “Copilot” icon on the taskbar or pressing Windows+C. It offers support similar to Bing search or ChatGPT and even supports plugins. The interface has been improved, allowing users to open it with Alt+Tab and undock it for use as a regular desktop window.

Paint Co-Creator: AI Art Generation

Windows 11’s Paint now includes the Co-Creator feature, which generates AI art. Users can find the “Co-Creator” button in the toolbar and use OpenAI’s DALL-E 3 model to generate images. They can customize the style, choosing between “realistic” or “pixel art” options.

OCR in Snip & Sketch

Windows 11’s Snip & Sketch tool now supports Optical Character Recognition (OCR). Users can press Windows+Shift+S to open the capture interface and copy text from images or any application on the screen. After capturing a screenshot, they can use the “Text Tool” button in the Snip & Sketch preview window to copy the text or remove sensitive information.

Background Removal in Paint

In Windows 11’s Paint, users can remove backgrounds from images. They simply need to open an image in Paint and click the “Remove Background” button in the toolbar. The AI technology detects the background and allows users to paste foreground elements onto other images.

Background Blur in Photos App

The Photos app in Windows 11 now offers the ability to blur backgrounds. Users can open an image, click the “Edit Image” button, or press Ctrl+E. The “Blur Background” button in the toolbar uses AI to detect the background, providing users with customizable blur options.

Automatic Video Composition in Clipchamp

Microsoft’s Clipchamp video editor now integrates AI editing capabilities. Users can launch Clipchamp, go to the Home tab, and select the “Create Video with AI” option. The AI model automatically identifies highlights in videos, resulting in professionally designed videos.

Copilot in Microsoft Edge

The Copilot sidebar is also available in Microsoft’s Edge browser. By clicking on the Copilot icon in the browser toolbar, users can utilize the “Compose” tab to quickly write paragraphs, emails, lists, or blog posts. The written content can be copied and pasted into other applications or directly inserted into websites.

Smart App Control

Windows 11 introduces Smart App Control, an AI-based feature that predicts the safety of downloaded and executed apps. Although currently limited to newly installed Windows 11, this feature enhances application security by allowing only trusted apps to run on users’ PCs.

Windows Studio Effects with NPU

Windows 11 utilizes Neural Processing Units (NPUs) to enhance Windows Studio effects. These effects improve video and audio quality during video and voice calls. Background effects, eye contact, and voice focus are among the features that enhance the overall video and audio experience. Users can access these effects by going to the camera settings in the Start menu.

Copilot for Microsoft 365 (Business Only)

Copilot for Microsoft 365, also known as Microsoft 365 Copilot, is an AI feature integrated with Microsoft Office applications. While currently available for businesses, it is expected to be accessible to personal Microsoft 365 users in the future. Copilot assists with tasks such as document writing and email summarization.

These AI features in Windows 11 are just the beginning, as Microsoft actively works to expand AI capabilities in future versions. Windows AI Studio aims to simplify the download and installation of AI models, further enhancing the AI environment in Windows. Stay updated on the latest AI features and tips through the Windows Intelligence Newsletter.

If you’re curious about the source of this article, it was originally published by Computerworld.