The artificial intelligence chatbot’s GPT-3 version scored a 65.1 percent on the exam, while its GPT-4 update fared worse, at 62.4 percent, according to the May 22 study in the American Journal of Gastroenterology. A score of 70 percent or higher is required to pass.
The study’s authors recommended against using ChatGPT for GI education in its current form. The researchers are affiliated with New Hyde Park, N.Y.-based Northwell Health and North Little Rock-based Arkansas Gastroenterology.
At the Becker's 11th Annual IT + Revenue Cycle Conference: The Future of AI & Digital Health, taking place September 14–17 in Chicago, healthcare executives and digital leaders from across the country will come together to explore how AI, interoperability, cybersecurity, and revenue cycle innovation are transforming care delivery, strengthening financial performance, and driving the next era of digital health. Apply for complimentary registration now.
