Should healthcare AI be more ‘humble’?

Advertisement

AI chatbots often project overconfidence, expressing certainty where it doesn’t exist. That’s dangerous for healthcare.

So researchers affiliated with Beth Israel Lahey Health, the Massachusetts Institute of Technology and Harvard University, all based in Cambridge, developed a framework to make AI more “humble” when dispensing clinical advice. They published their findings March 23 in BMJ Health and Care Informatics.

“We are trying to include humans in these human-AI systems, so that we are facilitating humans to collectively reflect and reimagine, instead of having isolated AI agents that do everything,” said lead author Sebastián Andrés Cajas Ordoñez, a researcher at MIT Critical Data, in a March 24 news release. “We want humans to become more creative through the usage of AI.”

Previous research has found that ICU physicians defer to AI they perceive as reliable even if it goes against their intuition, and that both physicians and patients are more likely to trust incorrect medical recommendations if they come across as authoritative, the release noted. The researchers plan to introduce their framework — called BODHI (Balanced, Open-minded, Diagnostic, Humble, and Inquisitive) — to clinicians at Beth Israel Lahey Health.

At the Becker's 11th Annual IT + Revenue Cycle Conference: The Future of AI & Digital Health, taking place September 14–17 in Chicago, healthcare executives and digital leaders from across the country will come together to explore how AI, interoperability, cybersecurity, and revenue cycle innovation are transforming care delivery, strengthening financial performance, and driving the next era of digital health. Apply for complimentary registration now.

Advertisement

Next Up in Technology & AI

Advertisement