Large Language Model Shows Promise in Helping Clinicians Identify Postpartum Hemorrhage – Technology Org

Postpartum hemorrhage is the leading cause of maternal mortality and morbidity worldwide and a common pregnancy complication. This serious medical condition is understudied and not universally defined or well-represented in health records.

Large Language Model Shows Promise in Helping Clinicians Identify Postpartum Hemorrhage – Technology Org

A newborn in a medical incubator – associative photo. Image credit: Hush Naidoo Jade Photography via Unsplash, free license

A new study by investigators from Brigham and Women’s Hospital, a founding member of the Mass General Brigham healthcare system, used the large language model Flan-T5 to extract medical concepts from electronic health records in order to define better and identify the populations impacted by postpartum hemorrhage. 

The study found the model to be 95 percent accurate in identifying patients with the condition, and resulted in 47 percent more patients identified than when using the standard method of tracking the condition through billing codes.

The tool showed great promise for helping clinicians identify subpopulations that are at higher risk of postpartum hemorrhage—and predicting those who are more likely to develop it. The results are published in npj Digital Medicine.

“We need better ways to identify the patients that have this complication, as well as the different clinical factors associated with it,” said corresponding author Vesela Kovacheva, MD, of the Department of Anesthesiology, Perioperative and Pain Medicine.

“So many amazing large language models are being developed right now, and this approach could be used with other conditions and diseases.”

The emergence of artificial intelligence tools in healthcare has been groundbreaking and can potentially reshape the continuum of care positively. As one of the nation’s top integrated academic health systems and largest innovation enterprises, Mass General Brigham is leading the way in conducting rigorous research on new and emerging technologies to inform the responsible incorporation of AI into care delivery, workforce support, and administrative processes.

Because conditions like postpartum hemorrhage include a large spectrum of patients, symptoms, and causes, the research team used the Flan-T5 model to analyze comprehensive information from electronic health records to help them better categorize subpopulations of patients. They prompted the Flan-T5 model with lists of concepts known to be associated with postpartum hemorrhage.

Then they asked it to extract them from the discharge summaries of a cohort of 131,284 patients who gave birth at Mass General Brigham hospitals between 1998-2015. This method achieved rapid and accurate results without the need for manual labeling.

“We looked at all of the patients that Flan-T5 identified as having postpartum hemorrhage and looked at what fraction of those also had the corresponding billing code. It turns out that Flan-T5 was 95 percent accurate and allowed us to identify 47 percent more patients than we would have from the billing codes alone,” said first author Emily Alsentzer, PhD, a research fellow in the Division.

“Ideally, we would like to be able to predict who will develop postpartum’ hemorrhage before they do so, and this is a tool that can help us get there.”

Next, the team plans to continue to use this approach to look at other pregnancy complications and hopes their work will help address growing maternal health crises in the United States. 

“This approach can be applied to many future studies,” said Kovacheva. “And it could be used to help guide real-time medical decision making, which is very exciting and valuable to me as a clinician.”

Source: BWH