title: Reliability of a minimal competency score for an annual skills mastery assessment.
abstract: OBJECTIVE
  To determine whether the modified Angoff process can be used to calculate a reliable minimal competency ("cut") score for the Annual Skills Mastery Assessment (ASMA).
  
  
  METHODS
  Three panels of pharmacy faculty members used a modified Angoff method to create a minimal competency score for 60 previously used test items. The panels did not know which items were included. Data were analyzed to determine differences between rating sessions, faculty type, item difficulty, and rater scoring bias.
  
  
  RESULTS
  The cut score generated was not significantly different by session or faculty type. The range of cut scores varied by less than 3% per examination. Faculty panelists correctly predicted student performance on items grouped as easy, medium, and hard.
  
  
  CONCLUSIONS
  A properly constructed faculty panel can determine a reliable cut score and accurately rank relative test item difficulty using the modified Angoff process.
authors.affiliation: School of Pharmacy, Wingate University, Wingate, North Carolina.
authors.forename: Gregory L
authors.initials: GL
authors.lastname: Alston
authors.affiliation: School of Pharmacy, Wingate University, Wingate, North Carolina.
authors.forename: Wesley R
authors.initials: WR
authors.lastname: Haltom
mesh_terms: D002983:Clinical Competence; D004512:Education, Pharmacy / Q000592:standards*; D004521:Educational Measurement / Q000592:standards*; D005178:Faculty; D015203:Reproducibility of Results; D012984:Software; D013339:Students, Pharmacy
keywords: Angoff method; assessment; competency; mile marker examination; modified Angoff method; progress examination