PTH-146 Validation of direct observation of procedural skills (DOPS) assessments for paediatric colonoscopy

Introduction Direct observation of procedural skills (DOPS) are tools designed by the Joint Advisory Group (JAG) to assess competence in endoscopy. These were expanded in July 2016 (new DOPS) to include those specific to paediatric colonoscopy. However, paediatric colonoscopy DOPS assessments have not been validated. We aimed to correlate overall trainee competence with components of the paediatric colonoscopy DOPS. Subjects and Methods We performed a prospective UK-wide analysis of formative paediatric colonoscopy DOPS submitted to the JETS e-Portfolio over one-year (August 2016–2017). Scores were averaged across procedural domains (pre-procedural, procedural, post-procedural and endoscopic non-technical skills – ENTS). Each DOPS item, except for ENTS, were grouped into cognitive and technical skillsets by two independent investigators, and correlated with the overall performance score. Correlation analyses were performed using Spearman’s test (rho u003e0.70 indicating high positive correlation). Results 61 DOPS assessments were completed by 13 unique trainers for 14 trainees. Overall performance score comprised: 1: Maximal supervision (1.6%), 2: Significant supervision (13.1%), 3: Minimal supervision (47.5%) and 4: Competent (37.7%). By domain, overall competence correlated most with scores for the ‘Procedural’ domain (rho: 0.849, p Conclusion Competencies in paediatric colonoscopy, as assessed within DOPS, vary in their correlation with overall competence. Performance in the ‘Procedural’ domain, Proactive Problem Solving’ items, and ‘Cognitive’ skillsets had greatest correlation with overall procedural competence. As assessors are completing the new DOPS in a consistent manner, this provides novel validity evidence for the new paediatric colonoscopy DOPS.