Primary care providers generate higher-quality notes than AI scribes, illustrating the need for humans to continue reviewing and editing drafts created by the technology, a new study found.
Researchers with the U.S. Department of Veterans Affairs had 30 humans blindly rate medical notes produced by 11 AI scribes and 18 human clinicians based on audio from five simulated cases. The raters evaluated each note across 10 domains using the modified Physician Documentation Quality Instrument, aka the PDQI-9.
The human-written notes scored better in every category, particularly standing out in thoroughness, organization and usefulness, according to the April 17 study in Annals of Internal Medicine.
“Although ambient AI scribes hold promise for reducing clinician burden, independent, vendor-neutral evaluations of note quality are essential before large-scale clinical deployment,” the researchers concluded.
At the Becker's 11th Annual IT + Revenue Cycle Conference: The Future of AI & Digital Health, taking place September 14–17 in Chicago, healthcare executives and digital leaders from across the country will come together to explore how AI, interoperability, cybersecurity, and revenue cycle innovation are transforming care delivery, strengthening financial performance, and driving the next era of digital health. Apply for complimentary registration now.