title: Evaluating oral case presentations using a checklist: how do senior student-evaluators compare with faculty?
abstract: OBJECTIVE
  Previous studies have shown student-evaluators to be reliable assessors of some clinical skills, but this model has not been studied for oral case presentations (OCPs). The purpose of this study was to examine the validity of student-evaluators in assessing OCP by comparing them with faculty.
  
  
  METHODS
  In 2010, the authors developed a dichotomous checklist. They trained 30 fourth-year medical students (student-evaluators) to use it to assess 170 second-year medical students' OCPs in real time during a year-end objective structured clinical examination. Ten faculty physicians then scored videos of a random sample of these OCPs. After discarding items with poor faculty reliability, the authors assessed agreement between faculty and student-evaluators on 18 individual items, total scores, and pass/fail decisions.
  
  
  RESULTS
  The total score correlation between student-evaluators and faculty was 0.84 (P < .001) and was somewhat better than the faculty-faculty intraclass correlation (r = 0.71). Using a 70% pass/fail cutoff, faculty and student-evaluator agreement was 74% (Kappa = 0.46; 95% CI, 0.20-0.72). Overall, student-evaluator scores were more lenient than faculty scores (72% versus 56% pass rates; P = .03).
  
  
  CONCLUSIONS
  Senior student-evaluators were able to reliably assess second-year medical students' OCP skills. The results support the use of student-evaluators for peer assessment of OCPs in low-stakes settings, but evidence of leniency compared with faculty assessment suggests caution in using student-evaluators in high-stakes settings. Extending peer assessment to OCPs provides a practical approach for low-resource evaluation of this essential skill.
authors.affiliation: Department of Medicine, The George Washington University School of Medicine and Health Sciences, Washington, DC 20037, USA. skakar@mfa.gwu.edu
authors.forename: Seema P
authors.initials: SP
authors.lastname: Kakar
authors.forename: Jillian S
authors.initials: JS
authors.lastname: Catalanotti
authors.forename: Andrea L
authors.initials: AL
authors.lastname: Flory
authors.forename: Samuel J
authors.initials: SJ
authors.lastname: Simmens
authors.forename: Karen L
authors.initials: KL
authors.lastname: Lewis
authors.forename: Matthew L
authors.initials: ML
authors.lastname: Mintz
authors.forename: Yolanda C
authors.initials: YC
authors.lastname: Haywood
authors.forename: Benjamin C
authors.initials: BC
authors.lastname: Blatt
mesh_terms: D057189:Checklist; D002983:Clinical Competence; D004219:District of Columbia; D004504:Education, Medical, Undergraduate / Q000379:methods*; D004521:Educational Measurement / Q000379:methods; D005180:Faculty, Medical; D006801:Humans; D010379:Peer Group; D010865:Pilot Projects; D013337:Students, Medical