Establishing passing standards for classroom achievement tests in medical education: a comparative study of four methods.
OBJECTIVE
The purpose of this research was to evaluate the Direct Borderline standard-setting method, designed for classroom instructor use, and to compare the characteristics of this newer method to three well-established methods. Most standard-setting methods were designed for large-scale assessments, and most research has taken place in the context of high-stakes examinations.


METHODS
Four absolute standard-setting methods (Nedelsky, Direct Borderline, Hofstee, and Ebel) were studied for year 1 and 2 basic science examinations.


RESULTS
The Direct Borderline method produced passing scores similar to the Nedelsky method and was reproducible. The Hofstee and Ebel methods produced the lowest passing scores. Standard errors at the passing score were the same or lower for the Direct Borderline method compared with the Nedelsky method.


CONCLUSIONS
The Direct Borderline method has reasonable psychometric characteristics and may be practical for faculty to use in establishing absolute passing standards for classroom achievement tests.
Downing
Steven M
SM
Deparment of Medical Education, College of Medicine, University of Illinois at Chicago, 60612-7309, USA. sdowning@uic.edu
Lieska
Norman G
NG
Raible
Michele D
MD
D000124:Achievement; D004504:Education, Medical, Undergraduate; D004521:Educational Measurement / Q000379:methods*; D006801:Humans; D015203:Reproducibility of Results