Artificial intelligence-based assessment of built environment from Google Street View and coronary artery disease prevalence

Background and Aims Built environment plays an important role in the development of cardiovascular disease. Tools to evaluate the built environment using machine vision and informatic approaches have been limited. This study aimed to investigate the association between machine vision-based built environment and prevalence of cardiometabolic disease in US cities.Methods This cross-sectional study used features extracted from Google Street View (GSV) images to measure the built environment and link them with prevalence of coronary heart disease (CHD). Convolutional neural networks, linear mixed-effects models, and activation maps were utilized to predict health outcomes and identify feature associations with CHD at the census tract level. The study obtained 0.53 million GSV images covering 789 census tracts in seven US cities (Cleveland, OH; Fremont, CA; Kansas City, MO; Detroit, MI; Bellevue, WA; Brownsville, TX; and Denver, CO).Results Built environment features extracted from GSV using deep learning predicted 63% of the census tract variation in CHD prevalence. The addition of GSV features improved a model that only included census tract-level age, sex, race, income, and education or composite indices of social determinant of health. Activation maps from the features revealed a set of neighbourhood features represented by buildings and roads associated with CHD prevalence.Conclusions In this cross-sectional study, the prevalence of CHD was associated with built environment factors derived from GSV through deep learning analysis, independent of census tract demographics. Machine vision-enabled assessment of the built environment could potentially offer a more precise approach to identify at-risk neighbourhoods, thereby providing an efficient avenue to address and reduce cardiovascular health disparities in urban environments. Structured Graphical Abstract Extracted features from street view images via artificial intelligence (AI) demonstrate that 63% of the variation in coronary heart disease (CHD) prevalence can be explained by these environmental factors, highlighting the significant potential of this data in informing cardiovascular health assessments. AIC, Akaike information criterion; BIC, Bayesian information criterion; DSE, demographic and socio-economic; GSV, Google Street View; LMEM: linear mixed-effects model; LRT, likelihood ratio test.