Closing the Feedback Loop: A 12-month Evaluation of ASTA, a Self-Tracking Application for ASHAs.

Accredited Social Health Activists (ASHAs) have been shown to have a positive impact on health outcomes of the households they visit, particularly in maternal and neonatal health. As the first line of the public health system in many countries, they are a critical link to the broader public health infrastructure for community members. Yet they do this all with minimal training and limited support infrastructure. To a pregnant woman, an ASHA is a trusted ally in navigating the health system---information gathered is returned by appropriate advice and counseling. To the health system, the ASHA is a key channel of valuable householdlevel information for the public health system, yet she generally receives minimal guidance in return. In this paper we present ASTA---the ASHA Self-Tracking Application---a system that provides ASHAs with timely, on-demand information regarding their own performance compared to their peers. Using ASTA, ASHAs access comparative performance data through both a web-based and voice-based interface on demand. We evaluated ASTA through a 12-month deployment with 142 ASHAs in Uttar Pradesh, India, assessing the impact of providing feedback on ASHA performance. We find that ASHAs with access to the ASTA system made significantly more client visits, with average monthly visits 21.5% higher than ASHAs who had access to a control system. In addition, higher ASHA performance was correlated with increased usage of ASTA. However, the performance improvement was front-loaded, with the impact of the system decreasing toward the end of the study period. Taken together, our findings provide promising evidence that studying and incorporating tools like ASTA could be cost effective and impactful for ASHA programs.