Systems Analysis of Bias and Risk in AI-Enabled Medical Diagnosis.

AI technologies have made significant advancements across various sectors, especially healthcare. Although AI algorithms in healthcare showcase remarkable predictive capabilities, apprehensions have emerged owing to errors, biases, and a lack of transparency. These concerns have led to a decline in trust among clinicians and patients, while also posing the risk of further accentuating pre-existing biases against marginalized groups and exacerbating inequities. This paper presents a scenario-based preferences risk register ^{1 1} Denotes a methodically arranged document or database detailing potential risks linked to particular scenarios or situations. framework for identifying and accounting AI algorithm biases in diagnosing diseases. The framework is demonstrated with a realistic case study on cardiac sarcoidosis. The framework identifies success criteria, initiatives, emergent conditions and the most and least disruptive scenarios. The success criteria align with the National Institute of Standards and Technology AI Risk Management Framework (NIST AI RMF) trustworthy AI characteristics, and the scenarios are based on various statistical/computational bias that causes algorithmic bias. The framework provides valuable guidance for leveraging AI in healthcare, enhancing objective designs, and mitigating risks by adopting a figure of merit to score the initiatives and measuring the disruptive order. By prioritizing transparency, trustworthy AI, and identifying the most and least disruptive scenarios/biases, the framework promotes responsible and effective use of AI technologies in healthcare.