Misuse of AI chatbots tops list of 2026 health tech hazards

Advertisement

The misuse of AI chatbots in healthcare is the leading health technology hazard for 2026, according to a new report from patient safety organization ECRI.

The annual ranking highlights risks tied to the growing use of AI-powered chatbots by clinicians, patients and healthcare staff — even though the tools are not regulated as medical devices or validated for clinical use. ECRI, an independent, nonpartisan organization, released its findings Jan. 21 as part of its “Top 10 Health Technology Hazards” report.

In the report, ECRI warns that chatbots can generate responses that sound authoritative but may be inaccurate or misleading, potentially leading to patient harm. The organization notes that these systems rely on large language models that predict word patterns rather than truly understanding medical context, which can result in confident-sounding but unreliable guidance.

The report also identifies other safety threats that ECRI says require urgent attention in 2026. They include:

  1. Misuse of AI chatbots in healthcare

  2. Unpreparedness for a “digital darkness” event, or a sudden loss of access to electronic systems and patient information

  3. Substandard and falsified medical products

  4. Recall communication failures for home diabetes management technologies

  5. Misconnections of syringes or tubing to patient lines, particularly amid slow ENFit and NRFit adoption

  6. Underutilizing medication safety technologies in perioperative settings

  7. Inadequate device cleaning instructions

  8. Cybersecurity risks from legacy medical devices

  9. Health technology implementations that prompt unsafe clinical workflows

  10. Poor water quality during instrument sterilization

At the Becker's 11th Annual IT + Revenue Cycle Conference: The Future of AI & Digital Health, taking place September 14–17 in Chicago, healthcare executives and digital leaders from across the country will come together to explore how AI, interoperability, cybersecurity, and revenue cycle innovation are transforming care delivery, strengthening financial performance, and driving the next era of digital health. Apply for complimentary registration now.

Register to Attend Webinar

AI literacy & clinical expertise: Keeping human judgment sharp as AI scales

Wednesday, August 12
11:00 AM - 12:00 PM CDT

Presenters: Lisa Ivanjack, MD, MHCM, FACP, ProvidenceJohn-Paul Mead, MD, Centralus HealthWilliam Gustin, MD, Moab Regional HospitalAmanda Heidemann, MD, FAAFP, FAMIA, Wolters Kluwer HealthYaw Fellin, Wolters Kluwer Health

Advertisement

Next Up in Artificial Intelligence

Advertisement