title: A pilot study of the relationship between experts' ratings and scores generated by the NBME's Computer-Based Examination System.
abstract: This pilot study evaluates the consistency of experts' ratings of students' performances on the National Board of Medical Examiners' Computer Based Examination (CBX) cases and the relationship of those ratings to the CBX's scoring algorithm. The authors were investigating whether an automated scoring algorithm can adequately assess an examinee's management of a computer-simulated patient. In 1989-90, at the Michigan State University College of Human Medicine, eight students, completing a surgery clerkship, each managed eight CBX cases and took a computer-administered, multiple-choice examination. Six clerkship coordinators rated the students' performances in terms of overall management, efficiency, and dangerous actions. The ratings correlated highly with scores produced by the CBX's scoring system.
authors.affiliation: Department of Internal Medicine, University of Texas Medical Branch, Galveston 77550.
authors.forename: D J
authors.initials: DJ
authors.lastname: Solomon
authors.forename: J R
authors.initials: JR
authors.lastname: Osuch
authors.forename: K
authors.initials: K
authors.lastname: Anderson
authors.forename: J
authors.initials: J
authors.lastname: Babel
authors.forename: J
authors.initials: J
authors.lastname: Gruenberg
authors.forename: J
authors.initials: J
authors.lastname: Kisala
authors.forename: M
authors.initials: M
authors.lastname: Milroy
authors.forename: W
authors.initials: W
authors.lastname: Stawski
mesh_terms: D000465:Algorithms; D002982:Clinical Clerkship; D002983:Clinical Competence; D003198:Computer Simulation; D004521:Educational Measurement / Q000379:methods*; D013502:General Surgery / Q000193:education*; D016544:Patient Simulation; D010865:Pilot Projects