Researchers from Los Angeles-based Cedars-Sinai and Stanford (Calif.) University examined 130 AI devices approved by the FDA between January 2015 and December 2020.
Almost all of the devices examined (126) only underwent retrospective studies rather than prospective analyses, and 93 failed to disclose whether they were assessed at more than one site in their summary documents. Both measures are crucial to guarantee the algorithms perform accurately and fairly.
The study authors advocated for medical AI devices to be evaluated in multiple clinical sites to ensure algorithms perform well across representative populations. They also encouraged medical AI devices to undergo prospective studies with comparison to standard of care so overfitting risks can be reduced and true clinical outcomes can be more accurately captured.
More articles on artificial intelligence:
Healthcare tops 100 most innovative AI companies: 8 digital health startups on the list
AI can use wireless signals to reduce errors in self-administered medication
Cleveland Clinic, IBM launch healthcare AI discovery center: 4 details
At the Becker's 11th Annual IT + Revenue Cycle Conference: The Future of AI & Digital Health, taking place September 14–17 in Chicago, healthcare executives and digital leaders from across the country will come together to explore how AI, interoperability, cybersecurity, and revenue cycle innovation are transforming care delivery, strengthening financial performance, and driving the next era of digital health. Apply for complimentary registration now.