RELIABILITYAND VALIDITY EVIDENCE FOR THE DUAL-DISORDER TREATMENTFIDELITY SCALE

ACKNOWLEDGMENTS Without cooperation from the Adult Mental Health Division (AMHD) at the Hawai'i Department of Health this research would not have been possible. I would like to thank the six participating programs as well as the AMHD Mental Health Services Research and Evaluation Center for their support ofthis project. 111 IV ABSTRACT Psychometric properties ofthe Dual-Disorder Treatment Fidelity Scale (Mueser, Noordsy, Drake & Fox, 2003) were evaluated. Reliability was assessed through measures of inter-rater agreement, and validity was assessed through concurrent, predictive, and construct validation procedures. Two raters assessed 3 community,mental health center (CMHC) and 3 dual diagnosis enhanced (DDE) programs,for fidelity. Fifty-two consumers,and 58 staff completed an outcomes survey and a measure ofknowledge about the model, respectively. Inter-rater agreement on fidelity ratings across programs, within each program, and for most scale items was good. Total fidelity scores did not distinguish between CMHC and DDE program types; however, a cluster analysis revealed concurrent validity based on the item level ratings. Fidelity scores did not predict consumer outcomes, and fidelity was unrelated to staff knowledge ofthe integrated model. Conclusions drawn from item level ratings appear valid; the validity of conclusions based on total fidelity scores remains unknown.