Feasibility and Efficacy of Systematic App Based Feedback in Medical Education of Emergency Medicine: a Prospective Observational Trial

Background In Germany relevant competences for anesthesiology residents were defined as entrustable professional activities. App supported formative assessment and feedback might improve education in students. Methods All fifth year medical students undergoing specific emergency medicine training in October 2022 were included. One half was educated using 360 degree App for systematic feedback and formative assessment, while the other ones received regular feedback. Results We finally included the data of 104 medical students (50 within the experimental group, 54 within the control group). There was no difference in the results of the evaluation (p = 0.225). The experimental (14.12 min [+/- 4.37]) compared to the control group (11.15 min [+/- 3.32]) received a longer feedback (2.97 min, p < 0.001). The mean duration of the systematic EPA based feedback was 5.62 min (+/- 1.6 min). The results of the self-assessment before (p = 0.051) and after (p = 0.134) scenario training were not different. The same was true for the comparison of self- and objective assessments regarding the need for supervision (p = 0.480). Conclusion The present observational prospective trial showed that implementation of an App based formative assessment and feedback is possible. However, this was not associated with differences in evaluation, self- and objective assessments.