E-156 Brainomix easpects software improves interobserver agreement and accuracy of neurologist and neuroradiologists in interpretation of aspects score and outperforms human readers in prediction of final infarct

Introduction There has been increased interest in the use of artificial intelligence based software packages in the evaluation of neuroimaging for patients with acute ischemic stroke. We performed an inter-rater agreement and accuracy study to determine if the use of the Brainomix eASPECTS software improved interobserver agreement and accuracy in detecting ASPECTS regions affected in anterior circulation LVO. Methods We included 60 consecutive patients with anterior circulation LVO who had TICI 3 revascularization within 60 minutes of their baseline CT. A total of 16 readers; 6 senior neuroradiologists, 6 junior neuroradiologists and 4 vascular neurologists participated. Readers interpreted CT scans on an independent workstation and assessed final ASPECTS score and evaluated whether each individual ASPECTS region was affected. Two months later, the readers again evaluated the CT scans, but with the assistance of eASPECTS software. We assessed interclass correlation coefficient for total ASPECTS and interobserver agreement with Fleiss’ Kappa for each ASPECTS region with and without assistance of the eASPECTS software. We also assessed accuracy for the readers with and without eASPECTS software assistance. In our assessment of accuracy, ground truth was the 24 hour CT in this cohort of patients who had prompt and complete revascularization as determined by two neuroradiologists. Results Interclass correlation coefficient for total ASPECTS without eASPECTS assistance was 0.395 indicating fair agreement compared to 0.574 with eASPECTS assistance indicating good agreement (P Conclusions The use of Brainomix eASPECTS software result in significant improvements in the inter-rater agreement and accuracy of ASPECTS score evaluation in a large group of neuroradiologists and neurologists. Interestingly, the eASPECTS software was more predictive of final infarct/ASPECTS than the overall group of readers interpreting the CT scans with and without eASPECTS assistance. Disclosures W. Brinjikji: None. J. Benson: None. N. Campeau: None. C. Carr: None. P. Cogswell: None. J. Klaas: None. G. Liebo: None. J. Little: None. P. Luetmer: None. S. Messina: None. A. Nagelschneider: None. K. Schwartz: None. C. Wood: None. D. Nasr: None. S. Braksick: None. D. Kallmes: None.