title: A predictive and construct validity study of a high-stakes objective clinical examination for assessing the clinical competence of international medical graduates.
abstract: BACKGROUND
  The purpose of this study was to investigate the predictive and construct validity of a high-stakes objective structured clinical examination (OSCE) used to select candidates for a 3-month clinical rotation to assess practice-readiness status.
  
  
  CONCLUSIONS
  Analyses were undertaken to establish the reliability and validity of the OSCE. The generalizability coefficient (Ep(2)) for the assessment scores (checklist, global, and total) were all high, ranging from 0.73 to 0.84. Two discriminant analyses (promotion to the 3-month rotation and pass/fail status on the rotation) provided evidence of predictive validity with a 100% correct classification rate in the pass/fail rotation results. Factor analysis results provided evidence of construct validity with four factors identified: Clinical Skills, Internal Medicine, General Medical Knowledge, and Counseling. The known group differences between licensing status and residency experience also provided evidence of construct validity.
  
  
  CONCLUSIONS
  The results are encouraging for the predictive and construct validity of the OSCE as an assessment of clinical competence.
authors.affiliation: Faculty of Veterinary Medicine, University of Calgary, Calgary, Alberta, Canada.
authors.forename: Andrea
authors.initials: A
authors.lastname: Vallevand
authors.forename: Claudio
authors.initials: C
authors.lastname: Violato
mesh_terms: D000328:Adult; D002170:Canada; D002983:Clinical Competence / Q000592:standards*; D004521:Educational Measurement / Q000379:methods*; D005163:Factor Analysis, Statistical; D005260:Female; D005550:Foreign Medical Graduates; D006801:Humans; D008297:Male; D008875:Middle Aged