Microsoft unveiled new artificial intelligence and healthcare data tools on Thursday.
TakeAway Points:
- Microsoft unveiled a number of new AI and health-related technologies.
- The tools are intended to reduce the time that clinicians spend on administrative duties and assist health systems in developing AI applications more swiftly.
- It is the most recent illustration of Microsoft’s attempts to position itself as a pioneer in AI for healthcare.
AI tool for healthcare
These technologies include a set of medical imaging models, a health-care agent service, and an automated nursing documentation system.
The tools aim to help healthcare organizations build AI applications quicker and save clinicians time on administrative tasks, a major cause of industry burnout. Nurses spend as much as 41% of their time on documentation, according to a report from the Office of the Surgeon General.
“By integrating AI into health care, our goal is to reduce the strain on medical staff, foster collective health team collaboration, and enhance the overall efficiency of healthcare systems across the country,” Mary Varghese Presti, vice president of portfolio evolution and incubation at Microsoft Health and Life Sciences, said in a prerecorded briefing with reporters.
The new tools are the latest example of Microsoft’s efforts to establish itself as a leader in healthcare AI. Last October, the company unveiled a series of health features across its Azure cloud and Fabric analytics platform. It also acquired Nuance Communications, which offers speech-to-text AI solutions for health care and other sectors, in a $16 billion deal in 2021.
Many of the solutions Microsoft announced on Thursday are in the early stages of development or only available in preview. Health-care organizations will test and validate them before the company rolls them out more broadly. Microsoft declined to share what these new tools will cost.
Health-care AI models
Roughly 80% of hospital and health system visits include an imaging exam because doctors often rely on images to help treat patients.
Microsoft is launching a collection of open-source multimodal AI models that can analyze data types beyond just text, such as medical images, clinical records, and genomic data. Health-care organizations can use the models to build new applications and tools.
For example, digitizing a single pathology slide can require more than a gigabyte of storage, so many existing AI pathology models have trained on small pieces of slides at a time. Microsoft and Providence Health & Services built a whole-slide model that improves on mutation prediction and cancer subtyping, according to a paper published in the peer-reviewed journal Nature.
Now, health systems can build on it and fine-tune it to meet their needs.
“Getting a whole-slide foundation model for pathology has been a challenge in the past… and now we’re actually able to do it,” Sara Vaezy, chief strategy and digital officer at Providence, said in an interview. “It was really sort of a game changer.”
The models are available in the model catalog within Azure AI Studio, which serves as Microsoft’s generative AI development hub.
Health-care agent service
Microsoft also announced a new way for health systems to build AI agents.
AI agents vary in complexity, but they can help users answer questions, automate processes, and perform specific tasks.
Through Microsoft Copilot Studio, these organizations can create agents equipped with health-care-specific safeguards. When an answer contains a reference to clinical evidence, for instance, the source is shown, and a note indicates if the answer is AI-generated. Fabrications and omissions are also flagged, Microsoft said.
For example, a healthcare organization could build an AI agent to help doctors identify relevant clinical trials for a patient. Microsoft said a physician could type the question, “What clinical trials for a male 55-year-old with diabetes and interstitial lung disease?” and receive a list of potential options. It would save the doctor the time and effort of finding each trial.
AI agents that can help patients answer basic questions have been popular among the health systems that have already begun testing the service, Hadas Bitran, general manager of health AI at Microsoft Health and Life Sciences, said in a Q&A with reporters. Agents that can help doctors answer questions about recent guidelines and patients’ histories are also common, she added.
Microsoft’s healthcare agent service is available in a preview capacity starting Thursday.