Rochester, Minn.-based Mayo Clinic has reviewed and approved more than 100 clinical AI applications in 2026 under an executive-led governance process.
The health system requires every clinical AI tool to undergo review before deployment, evaluating factors including complexity, clinical setting, performance, patient safety, user training, workflow integration, privacy and security, and life-cycle management, according to a June 29 column by John Halamka, MD, president of Mayo Clinic Platform, and Paul Cerrato, senior research analyst at Mayo Clinic Platform.
Tools deemed complex or capable of affecting decisions in time-urgent scenarios cannot be used without proactive human review by qualified clinicians, they wrote.
The column contrasts Mayo’s approach with cases the authors say show the risks of insufficient oversight. It cites a lawsuit alleging ChatGPT contributed to a fatal overdose, as well as reporting from Scientific American describing an emergency department nurse in Nevada who refused a charge nurse’s order to administer IV fluids based on an AI sepsis alert; a physician later intervened with an alternative treatment.
Dr. Halamka and Mr. Cerrato argue that AI models, however sophisticated, cannot replace years of clinical judgment and sensory observation that experienced clinicians bring to bedside care. Mayo Clinic Platform’s governance framework reflects a broader industry push to formalize AI oversight as health systems accelerate deployment of clinical algorithms.
At the Becker's 11th Annual IT + Revenue Cycle Conference: The Future of AI & Digital Health, taking place September 14–17 in Chicago, healthcare executives and digital leaders from across the country will come together to explore how AI, interoperability, cybersecurity, and revenue cycle innovation are transforming care delivery, strengthening financial performance, and driving the next era of digital health. Apply for complimentary registration now.