Do clinical clerks provide candidates with adequate formative assessment during Objective Structured Clinical Examinations?
BACKGROUND
Various research studies have examined the question of whether expert or non-expert raters, faculty or students, evaluators or standardized patients, give more reliable and valid summative assessments of performance on Objective Structured Clinical Examinations (OSCEs). Less studied has been the question of whether or not non-faculty raters can provide formative feedback that allows students to take advantage of the educational opportunity that OSCEs provide. This question is becoming increasingly important, however, as the strain on faculty resources increases.


METHODS
A questionnaire was developed to assess the quality of feedback that medical examiners provide during OSCEs. It was pilot tested for reliability using video recordings of OSCE performances. The questionnaires were then used to evaluate the feedback given during an actual OSCE in which clinical clerks, residents, and faculty were used as examiners on two randomly selected test stations.


RESULTS
The inter-rater reliability of the 19-item feedback questionnaire was 0.69 during the pilot test. The internal consistency was found to be 0.90 during pilot testing and 0.95 in the real OSCE. Using this form, the feedback ratings assigned to clinical clerks were significantly greater than those assigned to faculty evaluators. Furthermore, performance on the same OSCE stations eight months later was not impaired by having been evaluated by student examiners.


CONCLUSIONS
While evidence of mark inflation within the clinical clerk examiners should be addressed with examiner training, the current results suggest that clerks are capable of giving adequate formative feedback to more junior colleagues.
Reiter
Harold I
HI
McMaster University, 1280 Main Street West, Hamilton, Ontario, Canada L8S 4K1.
Rosenfeld
Jack
J
Nandagopal
Kiruthiga
K
Eva
Kevin W
KW
D000328:Adult; D002982:Clinical Clerkship / Q000592:standards*; D004504:Education, Medical, Undergraduate / Q000379:methods*; D004521:Educational Measurement / Q000379:methods*; D006801:Humans; D007721:Knowledge of Results, Psychological; D008487:Medical History Taking; D009864:Ontario; D016544:Patient Simulation; D010817:Physician-Patient Relations; D010865:Pilot Projects; D016730:Program Development; D011786:Quality Control; D015203:Reproducibility of Results; D011795:Surveys and Questionnaires; D013663:Teaching / Q000379:methods*