Development of Patient Safety Measures to Identify Inappropriate Diagnosis of Common Infections

Background. Inappropriate diagnosis of infections results in antibiotic overuse and may delay diagnosis of underlying conditions. Here we describe the development and characteristics of 2 safety measures of inappropriate diagnosis of urinary tract infection (UTI) and community-acquired pneumonia (CAP), the most common inpatient infections on general medicine services. Methods. Measures were developed from guidelines and literature and adapted based on data from patients hospitalized with UTI and CAP in 49 Michigan hospitals and feedback from end-users, a technical expert panel (TEP), and a patient focus group. Each measure was assessed for reliability, validity, feasibility, and usability. Results. Two measures, now endorsed by the National Quality Forum (NQF), were developed. Measure reliability (derived from 24 483 patients) was excellent (0.90 for UTI; 0.91 for CAP). Both measures had strong validity demonstrated through (a) face validity by hospital users, the TEPs, and patient focus group, (b) implicit case review (kappa 0.72 for UTI; kappa 0.72 for CAP), and (c) rare case misclassification (4% for UTI; 0% for CAP) due to data errors (<2% for UTI; 6.3% for CAP). Measure implementation through hospital peer comparison in Michigan hospitals (2017 to 2020) demonstrated significant decreases in inappropriate diagnosis of UTI and CAP (37% and 32%, respectively, P < .001), supporting usability. Conclusions. We developed highly reliable, valid, and usable measures of inappropriate diagnosis of UTI and CAP for hospitalized patients. Hospitals seeking to improve diagnostic safety, antibiotic use, and patient care should consider using these measures to reduce inappropriate diagnosis of CAP and UTI.