A Comparative Study of Fairness in Medical Machine Learning.

Although the applications of machine learning (ML) are revolutionizing medicine, current algorithms are not resilient against bias. Fairness in ML can be defined as measuring the potential bias in algorithms with respect to characteristics such as race, gender, and age. In this paper, we perform a comparative study to detect the bias caused by imbalanced group representation in medical datasets. We investigate bias in medical imaging tasks for the following dataset: chest X-ray dataset (CXR lung segmentation) and Stanford Diverse Dermatology Image (DDI) dataset (skin cancer prediction). Our results show differences in the performance of the state-of-the-arts across different groups. To mitigate this performance disparity, we explored different bias mitigation approaches and demonstrated that integrating these approaches into ML models can improve fairness without degrading the overall performance.