Pass or fail? How ChatGPT has fared on medical exams

Here is how OpenAI’s ChatGPT artificial intelligence tool has fared on six different medical exams:

Advertisement

Exams ChatGPT passed:

  1. The tool passed a college-level microbiology exam, scoring 95 percent.
  2. GPT passed a Palo Alto, Calif.-based Stanford University Medical School of Medicine clinical reasoning exam with a score of 72 percent.
  3. The AI chatbot passed three exams associated with the United States Medical Licensing Examination.

 

Exams ChatGPT failed:

  1. The AI tool scored less than 30 percent on the American Urological Association’s Self Study Program for Urology.
  2. GPT-4 scored 62.4 percent on the American College of Gastroenterology Self-Assessment Test. A minimum score of 70 percent is needed to pass the exam.
  3. The chatbot scored less than 50 percent on its first attempt at a practice test used by ophthalmology students.

Becker’s 3rd Annual Fall Chief Pharmacy Officer Summit is the top tier event that the people leading the future of pharmacy convene. This 3-day event is built specifically for Chief Pharmacy Officers and senior pharmacy leaders. The sessions examine the workforce, financial and clinical priorities shaping pharmacy today. Becker’s is where candid discussions flourish and new ideas thrive. Becker's 3rd Annual Fall Chief Pharmacy Officer Summit

Advertisement

Next Up in Innovation

Advertisement

Comments are closed.