Construct validity of an objective structured clinical examination (OSCE) in psychiatry: associations with the clinical skills examination and other indicators.
OBJECTIVE
The construct validity of checklist and global process scores for an objective structured clinical examination (OSCE) in psychiatry was assessed. Multiple regression analysis was used to predict psychiatry OSCE scores from the clinical skills examination, an obstetrics/gynecology (OB/GYN) OSCE, and the National Board of Medical Examiners (NBME) psychiatry subject examination.


METHODS
Archival data from two successive classes of third-year medical students (1999-2000, N=142; 2000-2001, N=144) were aggregated and analyzed.


RESULTS
The pattern and magnitude of convergence and discrimination were indicative of adequate construct validity for both the psychiatry checklist scores and the global process score. Clinical skills examination scores for history taking, interpersonal skills, and physical examination were related to psychiatry OSCE scores that reflected the same skill set. Construct validity was fairly higher for the global process rating.


CONCLUSIONS
Evidence of construct validity of a psychiatry OSCE was obtained from multiple measures of performance, including the clinical skills examination. Findings lend support to the continued use of checklist and global process evaluations as part of OSCEs in psychiatry.
Park
Robin S
RS
Saint Louis University School of Medicine, Department of Psychiatry, 1221 S. Grand Blvd., St. Louis, MO 63104, USA. parkrs@slu.edu
Chibnall
John T
JT
Blaskiewicz
Robert J
RJ
Furman
Gail E
GE
Powell
Jill K
JK
Mohr
Clinton J
CJ
D000328:Adult; D002983:Clinical Competence / Q000706:statistics & numerical data*; D004502:Education, Medical, Continuing; D004521:Educational Measurement / Q000706:statistics & numerical data*; D005260:Female; D006176:Gynecology / Q000193:education; D006801:Humans; D008297:Male; D009774:Obstetrics / Q000193:education; D011570:Psychiatry / Q000193:education*; D012044:Regression Analysis; D015203:Reproducibility of Results; D013044:Specialty Boards / Q000706:statistics & numerical data