Microsoft Unveils New AI Tools to Aid Healthcare Professionals

Microsoft has developed a comprehensive chip model designed to enhance genetic mutation predictions and cancer classification accuracy (Reuters)

Microsoft has announced new AI and data health tools, including a suite of medical imaging models, healthcare agents, and automated documentation tools for nurses, as reported by CNBC.

These tools are designed to help healthcare organizations develop AI applications faster and alleviate physicians from time-consuming administrative tasks, which are a major cause of burnout. Nurses, for example, reportedly spend up to 41% of their time on documentation, according to a report from the U.S. Surgeon General.

The new tools highlight Microsoft’s efforts to position itself as a leader in AI within the healthcare sector. In October, the company revealed a range of health-focused features through its Azure cloud computing platform and Fabric analytics platform.

In 2021, Microsoft acquired Nuance Communications, a company specializing in AI-powered speech-to-text solutions for healthcare and other industries, in a deal worth $16 billion. Additionally, Microsoft decided to invest in the software startup Rubrik.

AI Models for Healthcare

With approximately 80% of hospital and healthcare system visits involving medical imaging, Microsoft has launched an open-source collection of multimodal AI models capable of analyzing various data types, including medical images, clinical records, and genomic data. Healthcare organizations can leverage these models to create new applications and tools.

For example, converting a single pathology slide to a digital format can require more than a gigabyte of storage, which is why AI-driven pathology models are often trained on small slide fragments. Microsoft, however, has developed a whole-slide model that improves the prediction of genetic mutations and cancer classification, as published in Nature. Healthcare systems can now adopt and tailor this model to meet their specific needs.

Sarah Voss, Chief Strategy and Digital Officer at Providence, remarked, "Obtaining a foundational model for a whole slide was a challenge in healthcare previously. But today, we can actually achieve it."

Healthcare Agent Services

Microsoft has introduced a new tool for healthcare systems to build AI agents capable of answering questions, automating processes, and performing specific tasks.

Through "Microsoft Copilot Studio," organizations can create agents equipped with healthcare-specific safeguards. When responses reference clinical guidelines, the source is displayed along with a note indicating that the answer was AI-generated.

For instance, healthcare organizations can build an AI agent to assist physicians in identifying relevant clinical trials for patients. A doctor might ask, "What are the clinical trials for a 55-year-old male with diabetes and interstitial lung disease?" and receive a list of potential options, saving them time and effort.

According to Hadas Bitran, General Manager of AI at Microsoft Health, AI agents designed to assist patients with basic inquiries are already popular among healthcare systems testing the service. She also noted the demand for agents helping doctors answer questions related to the latest guidelines and patient history.

Microsoft has launched a new platform utilizing virtual reality technology, aiming to enhance immersive experiences and expand interactive possibilities for users (Social Media)

Automated Documentation for Nurses

In August, Microsoft announced that the next phase of its partnership with Epic Systems would focus on building an AI-powered documentation tool for nurses.

Epic, a company that supplies healthcare software, holds electronic health records (EHRs) for over 280 million individuals in the U.S. and has a longstanding relationship with Microsoft.

Microsoft-owned Nuance also offers an automated documentation tool for doctors called "DAX Copilot," unveiled last year. This tool allows doctors to record patient visits in a structured format, which AI then automatically converts into notes and clinical summaries, eliminating the need for doctors to manually input this information after every visit.

This technology’s popularity surged this year, and Nuance announced that DAX Copilot was integrated into Epic’s EHR in January. However, until now, DAX Copilot has been available only to physicians. Microsoft is currently developing a similar tool optimized for nurses.