Rochester, Minn.-based Mayo Clinic has reviewed and approved more than 100 clinical AI applications in 2026 under an executive-led governance process.
The health system requires every clinical AI tool to undergo review before deployment, evaluating factors including complexity, clinical setting, performance, patient safety, user training, workflow integration, privacy and security, and life-cycle management, according to a June 29 column by John Halamka, MD, president of Mayo Clinic Platform, and Paul Cerrato, senior research analyst at Mayo Clinic Platform.
Tools deemed complex or capable of affecting decisions in time-urgent scenarios cannot be used without proactive human review by qualified clinicians, they wrote.
The column contrasts Mayo’s approach with cases the authors say show the risks of insufficient oversight. It cites a lawsuit alleging ChatGPT contributed to a fatal overdose, as well as reporting from Scientific American describing an emergency department nurse in Nevada who refused a charge nurse’s order to administer IV fluids based on an AI sepsis alert; a physician later intervened with an alternative treatment.
Dr. Halamka and Mr. Cerrato argue that AI models, however sophisticated, cannot replace years of clinical judgment and sensory observation that experienced clinicians bring to bedside care. Mayo Clinic Platform’s governance framework reflects a broader industry push to formalize AI oversight as health systems accelerate deployment of clinical algorithms.
Becker’s 3rd Annual Fall Chief Pharmacy Officer Summit is the top tier event that the people leading the future of pharmacy convene. This 3-day event is built specifically for Chief Pharmacy Officers and senior pharmacy leaders. The sessions examine the workforce, financial and clinical priorities shaping pharmacy today. Becker’s is where candid discussions flourish and new ideas thrive. Becker's 3rd Annual Fall Chief Pharmacy Officer Summit
