title: The Coordinators of Psychiatric Education (COPE) Residency In-Training Exam: a preliminary psychometric assessment.
abstract: OBJECTIVE
  The Coordinators of Psychiatric Education (COPE) Residency In-Training Exam is a formative exam for Canadian psychiatric residents that was reconstructed using assessment best practices. An assessment of psychometric properties was subsequently performed on the exam to ensure preliminary validity and reliability.
  
  
  METHODS
  An exam blueprint was developed based on the 2007 Royal College objectives for psychiatric training. A minimum pass level was established using a modified Angoff method. The exam was administered to all Canadian psychiatric residents in postgraduate years 2 to 5 with test reliability (Cronbach alpha) and item analysis performed. Exam validity was assessed through blueprint adherence and cross-year resident performance analysis.
  
  
  RESULTS
  Four hundred two exams were suitable for analysis. The overall mean score for all residents was 69.6% (SD=8.5) with significant differences in total scores between each of the postgraduate year groups, with consistently better performance with increasing time in residency. Cronbach alpha was 0.79.
  
  
  CONCLUSIONS
  The present study provides preliminary support that the reconstructed COPE Residency In-Training Exam demonstrates adequate reliability and validity, including showing the capacity to discriminate between levels of training.
authors.affiliation: University of Calgary Faculty of Medicine, Department of Psychiatry, 1403 29th Street NW, Calgary, Alberta, Canada. gregory.montgomery@calgaryhealthregion.ca
authors.forename: Gregory P J
authors.initials: GP
authors.lastname: Montgomery
authors.forename: David N
authors.initials: DN
authors.lastname: Crockford
authors.forename: Kent
authors.initials: K
authors.lastname: Hecker
mesh_terms: D004521:Educational Measurement; D006801:Humans; D007396:Internship and Residency / Q000458:organization & administration*; D011570:Psychiatry / Q000193:education* / Q000458:organization & administration*; D011594:Psychometrics / Q000379:methods