Unintentional failure to assess for experience in senior undergraduate OSCE scoring.
BACKGROUND
One goal of undergraduate assessment is to test students' (future) performance. In the area of skills testing, the objective structured clinical examination (OSCE) has been of great value as a tool with which to test a number of skills in a limited time, with bias reduction and improved reliability. But can OSCEs measure undergraduate internship expertise in basic clinical skills?


METHODS
Undergraduate students (n = 32) were given a questionnaire listing 182 basic clinical skills. We asked them to score the number of times they had performed each skill during their internships (a 12-month period in Year 6). We assessed the students at the end of Year 5 (before the start of their internships) and again at the start of Year 7 (undergraduate training takes 7 years in Belgium, with internships during Year 6), using a 14-station OSCE assessing basic clinical skills. Global ratings were used to score performance. The relationship between internship experience and the OSCE Year 7 score was analysed using a linear regression model, controlling for variation in OSCE scores from Year 5. A multi-level analysis was performed considering students as level-1 units and stations as level-2 units.


RESULTS
Year 7 OSCE scores (post-internships) were not affected by the number of times that students practised basic medical skills during their internships.


CONCLUSIONS
Scores on OSCEs do not seem to reflect clinical expertise acquired during internships. Other more integrated assessment methods may prove to be more valid for testing final undergraduate skills levels.
Peeraer
Griet
G
Dean's Office, Faculty of Medicine, University of Antwerp, Antwerp, Belgium. griet.peeraer@ua.ac.be
Muijtjens
Arno M M
AM
De Winter
Benedicte Y
BY
Remmen
Roy
R
Hendrickx
Kristin
K
Bossaert
Leo
L
Scherpbier
Albert J J A
AJ
D000124:Achievement; D000328:Adult; D001530:Belgium; D002983:Clinical Competence / Q000592:standards*; D003479:Curriculum; D005260:Female; D006801:Humans; D007396:Internship and Residency / Q000592:standards*; D008297:Male; D011795:Surveys and Questionnaires