Ethical debates amidst flawed healthcare artificial intelligence metrics.

Gallifant, Jack; Bitterman, Danielle S; Celi, Leo Anthony; Gichoya, Judy W; Matos, Joao; McCoy, Liam G; Pierce, Robin L · NPJ Digit Med · 2024

expert_opinion · Level V

Where this comes from

Abstract

Healthcare AI faces an ethical dilemma between selective and equitable deployment, exacerbated by flawed performance metrics. These metrics inadequately capture real-world complexities and biases, leading to premature assertions of effectiveness. Improved evaluation practices, including continuous monitoring and silent evaluation periods, are crucial. To address these fundamental shortcomings, a paradigm shift in AI assessment is needed, prioritizing actual patient outcomes over conventional benchmarking.