Hospitals fall short evaluating AI biases, study suggests

Hospitals are more likely to assess artificial intelligence and predictive models for accuracy than for potential biases, according to a study published Jan. 6 in Health Affairs.

Advertisement

Researchers at the University of Minnesota School of Public Health analyzed data from 2,425 hospitals nationwide that participated in the 2023 American Hospital Association Annual Survey.

Three key study findings:

  • About 65% of hospitals reported using AI-based predictive models, the majority of which were developed by their EHR vendor.
  • Of the hospitals using AI models, 61% reported evaluating them for accuracy, while just 44% reported evaluating them for bias. 
  • Hospitals with higher operating margins, in-house model development capabilities or membership in a health system were more likely to evaluate models for bias. 

“The growing digital divide between hospitals threatens equitable treatment and patient safety,” lead author Paige Nong, PhD, an assistant professor at University of Minnesota School of Public Health, said in a news release. “Many better-funded hospitals can design models tailored to their own patients, then conduct in-house evaluations of them. In contrast, hospitals with fewer resources are buying these products ‘off the shelf,’ which may not reflect the needs of local patients.”

The researchers recommended policies and programs that provide technical support and resources to help hospitals effectively evaluate and govern AI models to ensure safe and equitable use across the industry.

At the Becker's 11th Annual IT + Revenue Cycle Conference: The Future of AI & Digital Health, taking place September 14–17 in Chicago, healthcare executives and digital leaders from across the country will come together to explore how AI, interoperability, cybersecurity, and revenue cycle innovation are transforming care delivery, strengthening financial performance, and driving the next era of digital health. Apply for complimentary registration now.

Register to Attend Webinar

How Allina Health is building the operating system for AI transformation — and driving $7.3M in added annual surgical contribution margin

Wednesday, July 29
1:00 PM - 2:00 PM CDT

Presenters: William Evans, Allina HealthDonna Sajady, Allina HealthDavid Atashroo, MD, Qventus

Advertisement

Next Up in Artificial Intelligence

Advertisement

Comments are closed.