Researchers fed New England Journal of Medicine pediatric case challenges to ChatGPT version 4 — the newest model from OpenAI, which costs $20 a month. The chatbot misdiagnosed 72 of 100 cases and wrote a too-broad diagnosis for another 11.
In the study, ChatGPT also couldn’t identify relationships such as the one between autism and vitamin deficiencies.
The researchers said this is the first known accuracy test for learning language model chatbots and pediatric medical scenarios, “which require the consideration of the patient’s age alongside symptoms.” Clinical AI uses also require up-to-date information, which can be hard to come by for tech companies.
Becker’s 3rd Annual Fall Chief Pharmacy Officer Summit is the top tier event that the people leading the future of pharmacy convene. This 3-day event is built specifically for Chief Pharmacy Officers and senior pharmacy leaders. The sessions examine the workforce, financial and clinical priorities shaping pharmacy today. Becker’s is where candid discussions flourish and new ideas thrive. Becker's 3rd Annual Fall Chief Pharmacy Officer Summit