title: Reliability of the Part II Board Certification Examination in Psychiatry: interexaminer consistency.
abstract: OBJECTIVE
  The aim of the study was to examine the reliability (interexaminer consistency) of the American Board of Psychiatry and Neurology (ABPN) Part II (oral) examination in psychiatry.
  
  
  METHODS
  Grades were assigned independently by two examiners who observed the same examination in a 1-year cycle (1,422 candidates, two examinations each). The consistency between these pairs of grades (pass, condition, fail) was analyzed using a weighted kappa statistic.
  
  
  RESULTS
  There was perfect agreement between examiners in 67% of examinations, minor disagreement in 26%, and major disagreement in 7% (weighted kappa = 0.54-0.56).
  
  
  CONCLUSIONS
  The Part II ABPN examination demonstrates fair to good reliability as measured by interexaminer consistency. Development of more explicit grading criteria should further improve examiner agreement in future examinations.
authors.affiliation: Department of Psychiatry, University of Hawaii at Manoa, Honolulu 96826.
authors.forename: J F
authors.initials: JF
authors.lastname: McDermott
authors.forename: P E
authors.initials: PE
authors.lastname: Tanguay
authors.forename: S C
authors.initials: SC
authors.lastname: Scheiber
authors.forename: D
authors.initials: D
authors.lastname: Juul
authors.forename: J H
authors.initials: JH
authors.lastname: Shore
authors.forename: G J
authors.initials: GJ
authors.lastname: Tucker
authors.forename: L
authors.initials: L
authors.lastname: McCurdy
authors.forename: L C
authors.initials: LC
authors.lastname: Terr
mesh_terms: D004521:Educational Measurement / Q000592:standards* / Q000706:statistics & numerical data; D006801:Humans; D011570:Psychiatry / Q000592:standards*; D015203:Reproducibility of Results; D013044:Specialty Boards / Q000592:standards*; D014481:United States