The Growing Risks of AI in Healthcare

The annual report from ECRI sheds light on the most pressing health technology risks facing the healthcare sector…

Artificial intelligence (AI) in healthcare applications is at the forefront of ECRI’s 2025 report, which outlines significant hazards in health technology. ECRI, a global healthcare safety nonprofit, warns that while AI can enhance efficiency and medical outcomes, unmonitored AI systems may endanger patients.

AI has extended its influence beyond medical imaging, affecting various areas in healthcare such as diagnostics and patient scheduling. Experts from ECRI emphasize that even AI tools not categorized as medical devices can significantly alter patient care.

‘The promise of artificial intelligence’s capabilities must not distract us from its risks or its ability to harm patients and providers,’ said Marcus Schabacker, MD, PhD, president and CEO of ECRI.

Understanding the Risks

ECRI experts caution that AI systems can produce inaccurate outputs, termed ‘hallucinations,’ and the effectiveness of their results can differ across diverse patient demographics. Bias can also be perpetuated within AI models, especially affecting marginalized communities.

‘AI is only as good as the data it is given and the guardrails that govern its use,’ Schabacker stated. ‘Healthcare stakeholders must critically evaluate AI integration, just as they would with any new technology.’

Other Health Technology Hazards

The report also highlights additional technology risks, including:

1. Unmet technology support needs in home care
2. Cybersecurity threats from vulnerable technology vendors
3. Issues with counterfeit medical products
4. Fire risks associated with supplemental oxygen
5. Improperly set alarm limits on anesthesia units
6. Mishandled medication orders

The complete report is available to ECRI members, outlining actionable strategies for healthcare organizations to reduce risks and enhance patient safety. An executive brief can be downloaded for free at their official site.

Live Webcast Announcement

ECRI will host a live webcast on December 5 to discuss these hazards and their implications for patient safety. Attendees can gain insights on mitigating risks through expert discussions.