Development and assessment of machine learning models for predicting recurrence risk after endovascular treatment in patients with intracranial aneurysms

Intracranial aneurysms (IAs) remain a major public health concern and endovascular treatment (EVT) has become a major tool for managing IAs. However, the recurrence rate of IAs after EVT is relatively high, which may lead to the risk for aneurysm re-rupture and re-bleed. Thus, we aimed to develop and assess prediction models based on machine learning (ML) algorithms to predict recurrence risk among patients with IAs after EVT in 6 months. Patient population included patients with IAs after EVT between January 2016 and August 2019 in Hunan Provincial Peopleʼs Hospital, and an adaptive synthetic (ADASYN) sampling approach was applied for the entire imbalanced dataset. We developed five ML models and assessed the models. In addition, we used SHapley Additive exPlanations (SHAP) and local interpretable model-agnostic explanation (LIME) algorithms to determine the importance of the selected features and interpret the ML models. A total of 425 IAs were enrolled into this study, and 66 (15.5%) of which recurred in 6 months. Among the five ML models, gradient boosting decision tree (GBDT) model performed best. The area under curve (AUC) of the GBDT model on the testing set was 0.842 (sensitivity: 81.2%; specificity: 70.4%). Our study firstly demonstrated that ML-based models can serve as a reliable tool for predicting recurrence risk in patients with IAs after EVT in 6 months, and the GBDT model showed the optimal prediction performance.