The Coordinators of Psychiatric Education (COPE) Residency In-Training Exam: a preliminary psychometric assessment.
OBJECTIVE
The Coordinators of Psychiatric Education (COPE) Residency In-Training Exam is a formative exam for Canadian psychiatric residents that was reconstructed using assessment best practices. An assessment of psychometric properties was subsequently performed on the exam to ensure preliminary validity and reliability.


METHODS
An exam blueprint was developed based on the 2007 Royal College objectives for psychiatric training. A minimum pass level was established using a modified Angoff method. The exam was administered to all Canadian psychiatric residents in postgraduate years 2 to 5 with test reliability (Cronbach alpha) and item analysis performed. Exam validity was assessed through blueprint adherence and cross-year resident performance analysis.


RESULTS
Four hundred two exams were suitable for analysis. The overall mean score for all residents was 69.6% (SD=8.5) with significant differences in total scores between each of the postgraduate year groups, with consistently better performance with increasing time in residency. Cronbach alpha was 0.79.


CONCLUSIONS
The present study provides preliminary support that the reconstructed COPE Residency In-Training Exam demonstrates adequate reliability and validity, including showing the capacity to discriminate between levels of training.
Montgomery
Gregory P J
GP
University of Calgary Faculty of Medicine, Department of Psychiatry, 1403 29th Street NW, Calgary, Alberta, Canada. gregory.montgomery@calgaryhealthregion.ca
Crockford
David N
DN
Hecker
Kent
K
D004521:Educational Measurement; D006801:Humans; D007396:Internship and Residency / Q000458:organization & administration*; D011570:Psychiatry / Q000193:education* / Q000458:organization & administration*; D011594:Psychometrics / Q000379:methods