Lead Forensics

Science Journal: Beware explanations from Al in health care

Artificial intelligence and machine learning (AI/ML) algorithms are increasingly developed in health care for diagnosis and treatment of a variety of medical conditions. However, despite the technical prowess of such systems, their adoption has been challenging, and whether and how much they will actually improve health care remains to be seen. A central reason for this is that the effectiveness of AI/ML-based medical devices depends largely on the behavioral characteristics of its users, who, for example, are often vulnerable to well-documented biases or algorithmic aversion.

AI Health care benefits

Many stakeholders increasingly identify the so-called black-box nature of predictive algorithms as the core source of users’ skepticism, lack of trust, and slow uptake. As a result, lawmakers have been moving in the direction of requiring the availability of explanations for black-box algorithmic decisions. Indeed, a near-consensus is emerging in favor of explainable AI/ML among academics, governments, and civil society groups. Many are drawn to this approach to harness the accuracy benefits of noninterpretable AI/ML such as deep learning or neural nets while also supporting transparency, trust, and adoption. We argue that this consensus, at least as applied to health care, both overstates the benefits and undercounts the drawbacks of requiring black-box algorithms to be explainable.

Get full access to this article

By: Boris Babic, Sara Gerke, Theodoros Evgeniou and I. Glenn Cohen

JOIN OUR COMMUNITY

Stay ahead of the curve – sign up to receive the latest policy and tech advice impacting your business.

Share This Post

Further articles

DSA Compliance

Are you ready for your first DSA Transparency Report?

While the 25 Very Large Online PlatformsAn online platform refers to a digital service that enables interactions between two or more sets of users who are distinct but interdependent and use the service to communicate via the internet. The phrase “online platform” is a broad term used to refer to various internet services such as

Other

Content Moderation and Governance: Principles, Misconceptions and Challenges

Register here Friday, February 28, 4-5 PM CET Content moderation online is central in many debates today—about free speech and safety, business, democracy, and even national security and geopolitics. From landmark regulations like Section 230 in the US and the Digital Services Act (DSA) in the EU, to high-stakes legal battles and shifting corporate policies

Join our community

Stay ahead of the curve – sign up to receive the latest policy and tech advice impacting your business.