An AI model from OpenAI outperformed human physicians on emergency department diagnoses, a new study found.
Researchers compared the o1 model to two human physicians using 76 emergency cases at Boston-based Beth Israel Deaconess Medical Center. The AI identified the exact or a very close diagnosis more often, according to the April 30 study in Science. The researchers concluded that large language models have “eclipsed most benchmarks of clinical reasoning, motivating the urgent need for prospective trials.”
But they also note that AI isn’t replacing physicians. “There’s a lot of these so-called AI doctor companies out there that are trying to either cut doctors out of the loop or have minimal clinical supervision,” said co-author Adam Rodman, MD, an internist and medical educator at Beth Israel Deaconess, in a call with journalists reported by Vox. “As one of the senior authors on the study, I do not think that these results support that.”
At the Becker's 11th Annual IT + Revenue Cycle Conference: The Future of AI & Digital Health, taking place September 14–17 in Chicago, healthcare executives and digital leaders from across the country will come together to explore how AI, interoperability, cybersecurity, and revenue cycle innovation are transforming care delivery, strengthening financial performance, and driving the next era of digital health. Apply for complimentary registration now.
