Copilot Podcast: Windows Copilot Announcements from Microsoft Build 2024

Microsoft Copilot

In episode 37 of the “Copilot Podcast,” Aaron Back shares details on the announcements given at Microsoft Build 2024 around Windows Copilot.

This episode is sponsored by the AI Summit Preconference, a part of the Community Summit North America 2024 experience, taking place on October 13th in San Antonio, Texas. The full-day preconference will feature keynotes, panel discussions, tutorials, fireside chats, use-case analysis, innovation profiles, and more. Register for the AI Summit Preconference now.

Key Takeaways

  • Windows Copilot overview: Windows Copilot is a centralized AI assistant integrated within the Windows OS for PCs and Macs. Windows Copilot aims to empower every user by helping them take action, customize settings, and connect seamlessly across their favorite applications. It’s designed to be an always-on, accessible assistant, similar to other Copilot versions in various business applications.
  • Integrations: Windows Copilot is integrated into the Windows operating system. Aaron notes that Microsoft has also released the Windows Copilot Runtime, which enables developers to create AI experiences at any stage of their AI journey. The Runtime includes the Windows Copilot Library, offering a set of APIs and access to over 40 on-device AI models that come with Windows. This facilitates the use of AI frameworks and toolchains, especially for developers bringing their own on-device models to Windows.
  • Further functionality: Aaron provides an overview of the latest enhancements to Windows Copilot, including the introduction of Studio Effects which improves camera and audio features. He also mentions Recall, a feature that helps users resume past activities on their Windows devices, and Fie Silica, an on-device small language model that aids in natural language processing tasks.
  • New features: Aaron highlights several new features of Windows Copilot, including:
    • Text recognition, which is an advanced version of OCR, capable of extracting text from images and documents for conversion to PDFs or other formats.
    • Live caption translations, which aid communication in global organizations and assist individuals who are deaf or hard of hearing by providing captions of spoken content in the user’s preferred language.
    • Web Neural Network (WebNN), a developer preview introduced to Windows through DirectML, enabling web developers to leverage hardware capabilities for enhanced AI features.
  • Enhancing UX: These updates aim to democratize AI across all devices and applications, extending Microsoft’s AI solutions to the Windows ecosystem and enhancing the user experience.

Stream the audio version of this episode here:


Welcome to our new site!

Here you will find a wealth of information created for people  that are on a mission to redefine business models with cloud techinologies, AI, automation, low code / no code applications, data, security & more to compete in the Acceleration Economy!