title: A standardized rubric to evaluate student presentations.
abstract: OBJECTIVE
  To design, implement, and assess a rubric to evaluate student presentations in a capstone doctor of pharmacy (PharmD) course.
  
  
  METHODS
  A 20-item rubric was designed and used to evaluate student presentations in a capstone fourth-year course in 2007-2008, and then revised and expanded to 25 items and used to evaluate student presentations for the same course in 2008-2009. Two faculty members evaluated each presentation.
  
  
  RESULTS
  The Many-Facets Rasch Model (MFRM) was used to determine the rubric's reliability, quantify the contribution of evaluator harshness/leniency in scoring, and assess grading validity by comparing the current grading method with a criterion-referenced grading scheme. In 2007-2008, rubric reliability was 0.98, with a separation of 7.1 and 4 rating scale categories. In 2008-2009, MFRM analysis suggested 2 of 98 grades be adjusted to eliminate evaluator leniency, while a further criterion-referenced MFRM analysis suggested 10 of 98 grades should be adjusted.
  
  
  CONCLUSIONS
  The evaluation rubric was reliable and evaluator leniency appeared minimal. However, a criterion-referenced re-analysis suggested a need for further revisions to the rubric and evaluation process.
authors.affiliation: University of Toledo College of Pharmacy, Toledo, OH 43614, USA. michael.peeters@utoledo.edu
authors.forename: Michael J
authors.initials: MJ
authors.lastname: Peeters
authors.forename: Eric G
authors.initials: EG
authors.lastname: Sahloff
authors.forename: Gregory E
authors.initials: GE
authors.lastname: Stone
mesh_terms: D004512:Education, Pharmacy / Q000379:methods*; D004521:Educational Measurement; D006801:Humans; D015233:Models, Statistical; D015203:Reproducibility of Results; D013339:Students, Pharmacy