Radiologists with assistance of deep learning can achieve overall accuracy of benign–malignant differentiation of musculoskeletal tumors comparable with that of pre-surgical biopsies in the literature

Purpose The purpose of this study was to assess if radiologists assisted by deep learning (DL) algorithms can achieve diagnostic accuracy comparable to that of pre-surgical biopsies in benign–malignant differentiation of musculoskeletal tumors (MST). Methods We first conducted a systematic review of literature to get the respective overall diagnostic accuracies of fine-needle aspiration biopsy (FNAB) and core needle biopsy (CNB) in differentiating between benign and malignant MST, by synthesizing data from the articles meeting our inclusion criteria. To compared against the accuracies reported in literature, we then invited 4 radiologists, respectively with 2 (A), 6 (B), 7 (C), and 33 (D) years of experience in interpreting musculoskeletal MRI to perform diagnostic tests on our own dataset ( n = 62), with and without assistance of a previously developed DL algorithm. The gold standard for benign–malignant differentiation was histopathologic confirmation or clinical/radiographic follow-up. Results For FNAB, a meta-analysis containing 4604 samples met the inclusion criteria, with the overall diagnostic accuracy reported to be 0.77. For CNB, an overall accuracy of 0.86 was derived by synthesizing results from 7 original research articles containing a total of 587 samples. On our internal MST dataset, the invited radiologists, respectively, achieved diagnostic accuracies of 0.84 (A), 0.89 (B), 0.87 (C), and 0.90 (D), with the assistance of DL. Conclusion Use of DL algorithms on musculoskeletal dynamic contrast-enhanced MRI improved the benign–malignant differentiation accuracy of radiologists to a level comparable to that of pre-surgical biopsies. The developed DL algorithms have a potential to lower the risk of miss-diagnosing malignancy in radiological practice.