Interrater Reliability Of A Pediatric Outcome Measure In Nepal

The Hospital and Rehabilitation Centre for Disabled Children (HRDC) in Nepal identified the need to evaluate their in-hospital and community programmes. An instrument was developed to provide information regarding the functional level of the children treated by the HRDC as well as to provide information regarding care-givers' attitudes towards disability. Inter-rater reliability of the measure was tested in three regions of Nepal with 49 children. Six HRDC field workers travelled in pairs to the childrens' homes and alternated in roles as test administrator and observer. Correlations between the scores documented by the administrator and observer were used to estimate inter-rater reliability. Inter-rater reliability coefficients, calculated using a weighted kappa statistic, varied from 0.60 to 1.0. We conclude that the instrument demonstrated an acceptable level of inter-rater reliability in the field setting. Future studies to measure construct and concurrent validity, test-retest reliability and responsiveness of the instrument are recommended as well as testing the instrument in different cultures.