The news outlet cited a Feb. 3 study conducted by Cleveland Clinic and Stanford University that analyzed how well ChatGPT could answer healthcare questions regarding heart disease prevention.
The researchers, whose findings were published in JAMA, found that:
- ChatGPT was able to answer 21 of 25 questions correctly.
- ChatGPT responses were considered to be appropriate for a broad range of recommendations, including questions regarding weight loss, how to lower cholesterol and the meaning of certain coronary calcium scores.
- ChatGPT couldn’t understand nuanced questions, such as those regarding exercise. It “firmly recommended” cardio and weightlifting, an exercise that could harm some patients, according to the researchers.
- ChatGPT also missed key details on questions about cholesterol levels, and incorrectly suggested that a cardiovascular disease drug isn’t commercially available.
At the Becker's 11th Annual IT + Revenue Cycle Conference: The Future of AI & Digital Health, taking place September 14–17 in Chicago, healthcare executives and digital leaders from across the country will come together to explore how AI, interoperability, cybersecurity, and revenue cycle innovation are transforming care delivery, strengthening financial performance, and driving the next era of digital health. Apply for complimentary registration now.
