Automated translation accurately translates recorded pediatric neurosurgery clinic conversations between Spanish and English

The purpose of this study is to analyze an automated voice to text translation device by reporting the translation accuracy for recorded pediatric neurosurgery clinic conversations, classifying errors in translation according to their impact on overall understanding, and comparing the incidence of these errors in English to Spanish vs. Spanish to English conversations. English and Spanish speaking patients at a single academic health system’s outpatient pediatric neurosurgery clinic had their conversations recorded. These recordings were played back to a Google Pixel handheld smartphone with Live Translate voice to text translation software. A certified medical interpreter evaluated recordings for incidence of minor errors, errors impacting understanding, and catastrophic errors affecting patient-provider relationship or care. Two proportion t-testing was used to compare these outcomes. 50 patient visits were recorded: 40 English recordings translated to Spanish and 10 Spanish recordings translated to English. The mean transcript length was 4244 ± 992 words. The overall accuracy was 98.2