Assessing the generalizability of OSCE measures across content domains.
OBJECTIVE
To assess the degree to which OSCE measures generalize across multiple administrations to the same students.


METHODS
Students' scores from three OSCEs at one institution were correlated to determine the generalizability of the scoring systems across course domains.


RESULTS
Analysis revealed that while checklist scores showed quite low correlations across examinations from different domains (ranging from 0.14 to 0.25), global process scores showed quite reasonable correlations (ranging from 0.30 to 0.44), with the correlations for global scores being significantly higher than those for checklist scores in all three comparisons.


CONCLUSIONS
These data would seem to confirm the intuitions about each of these measures: the checklist scores are highly content-specific, while the global scores are evaluating a more broadly based set of skills. Implications for the use of these scales are discussed.
Regehr
G
G
Faculty of Medicine, University of Toronto, Ontario, Canada. g.regehr@utoronto.ca
Freeman
R
R
Hodges
B
B
Russell
L
L
D002982:Clinical Clerkship; D002983:Clinical Competence / Q000592:standards*; D003479:Curriculum; D003627:Data Interpretation, Statistical; D004504:Education, Medical, Undergraduate / Q000379:methods* / Q000592:standards*; D004521:Educational Measurement / Q000379:methods / Q000592:standards*; D006801:Humans; D008487:Medical History Taking / Q000592:standards; D010808:Physical Examination / Q000592:standards; D010817:Physician-Patient Relations; D013647:Task Performance and Analysis