Interpreting estimates of coronavirus disease 2019 (COVID-19) vaccine efficacy and effectiveness to inform simulation studies of vaccine impact: a systematic review

Background: The multiple efficacious vaccines authorised for emergency use worldwide represent the first preventative intervention against coronavirus disease 2019 (COVID-19) that does not rely on social distancing measures. The speed at which data are emerging and the heterogeneities in study design, target populations, and implementation make it challenging to interpret and assess the likely impact of vaccine campaigns on local epidemics. We reviewed available vaccine efficacy and effectiveness studies to generate working estimates that can be used to parameterise simulation studies of vaccine impact. Methods: We searched MEDLINE, the World Health Organization’s Institutional Repository for Information Sharing, medRxiv, and vaccine manufacturer websites for studies that evaluated the emerging data on COVID-19 vaccine efficacy and effectiveness. Studies providing an estimate of the efficacy or effectiveness of a COVID-19 vaccine using disaggregated data against SARS-CoV-2 infection, symptomatic disease, severe disease, death, or transmission were included. We extracted information on study population, variants of concern (VOC), vaccine platform, dose schedule, study endpoints, and measures of impact. We applied an evidence synthesis approach to capture a range of plausible and consistent parameters for vaccine efficacy and effectiveness that can be used to inform and explore a variety of vaccination strategies as the COVID-19 pandemic evolves. Results: Of the 602 articles and reports identified, 53 were included in the analysis. The availability of vaccine efficacy and effectiveness estimates varied by vaccine and were limited for VOCs. Estimates for non-primary endpoints such as effectiveness against infection and onward transmission were sparse. Synthesised estimates were relatively consistent for the same vaccine platform for wild-type, but was more variable for VOCs. Conclusions: Assessment of efficacy and effectiveness of COVID-19 vaccines is complex. Simulation studies must acknowledge and capture the uncertainty in vaccine effectiveness to robustly explore and inform vaccination policies and policy around the lifting of non-pharmaceutical interventions.