Global ratings of videotaped performance versus global ratings of actions recorded on checklists: a criterion for performance assessment with standardized patients.
OBJECTIVE
To test whether global ratings of checklists are a viable alternative to global ratings of actual clinical performance for use as a criterion for standardized-patient (SP) assessment.


METHODS
Five faculty physicians independently observed and rated videotaped performances of 44 medical students on the seven SP cases that comprise the fourth-year assessment administered at The Morchand Center of Mount Sinai School of Medicine to students in the eight member schools in the New York City Consortium. A year later, the same panel of raters reviewed and rated checklists for the same 44 students on five of the same SP cases.


RESULTS
The mean global ratings of clinical competence were higher with videotapes than checklists, whereas the mean global ratings of interpersonal and communication skills were lower with videotapes. The correlations for global ratings of clinical competence showed only moderate agreement between the videotape and checklist ratings; and for interpersonal and communication skills, the correlations were somewhat weaker.


CONCLUSIONS
The results raise serious questions about the viability of global ratings of checklists as an alternative to ratings of observed clinical performance as a criterion for SP assessment.
Swartz
M H
MH
The Morchand Center for Clinical Competence, Mount Sinai School of Medicine, New York, New York 10029, USA. mswartz@mssm.edu
Colliver
J A
JA
Bardes
C L
CL
Charon
R
R
Fried
E D
ED
Moroff
S
S
D000328:Adult; D002983:Clinical Competence; D004282:Documentation; D004521:Educational Measurement; D005260:Female; D006801:Humans; D008297:Male; D009519:New York City; D012577:Schools, Medical; D012680:Sensitivity and Specificity; D014743:Videotape Recording