title: Reliability of a faculty evaluated scoring system for anesthesiology resident applicants (Original Investigation).
abstract: OBJECTIVE
  To assess reliability and reproducibility of a recently instituted anesthesiology resident applicant interview scoring system at our own institution.
  
  
  METHODS
  Retrospective evaluation of 2 years of interview data with a newly implemented scoring system using randomly assigned interviewing faculty.
  
  
  METHODS
  Interview scoring evaluations were completed as standard practice in a large academic anesthesiology department.
  
  
  METHODS
  All anesthesiology resident applicants interviewed over the 2013/14 and 2014/15 seasons by a stable cohort of faculty interviewers. Data collection blinded for both interviewers and interviewees.
  
  
  METHODS
  None for purposes of study - collation of blinded data already used as standard practice during interview process and analysis.
  
  
  METHODS
  None specific to study.
  
  
  RESULTS
  Good inter-rater faculty reliability of interview scoring (day-of) and excellent inter-faculty reliability of application review (pre-interview).
  
  
  CONCLUSIONS
  Development of a department-specific interview scoring system including many elements beyond traditional standardized tests shows good-excellent reliability of faculty scoring of both the interview itself (including non-technical skills) and the application resume.
authors.affiliation: Department of Anesthesiology, University of Texas Medical School at Houston, MSB 5.020, 6431 Fannin Street, Houston, TX, 77030.
authors.forename: Sam D
authors.initials: SD
authors.lastname: Gumbert
authors.affiliation: Department of Anesthesiology, University of Texas Medical School at Houston, MSB 5.020, 6431 Fannin Street, Houston, TX, 77030.
authors.forename: Katherine C
authors.initials: KC
authors.lastname: Normand
authors.affiliation: Department of Anesthesiology, University of Texas Medical School at Houston, MSB 5.020, 6431 Fannin Street, Houston, TX, 77030.
authors.forename: Carlos A
authors.initials: CA
authors.lastname: Artime
authors.affiliation: Department of Anesthesiology, University of Texas Medical School at Houston, MSB 5.020, 6431 Fannin Street, Houston, TX, 77030.
authors.forename: Omonele O
authors.initials: OO
authors.lastname: Nwokolo
authors.affiliation: Department of Anesthesiology, University of Texas Medical School at Houston, MSB 5.020, 6431 Fannin Street, Houston, TX, 77030.
authors.forename: George
authors.initials: G
authors.lastname: Williams
authors.affiliation: Department of Anesthesiology, University of Texas Medical School at Houston, MSB 5.020, 6431 Fannin Street, Houston, TX, 77030.
authors.forename: Sara
authors.initials: S
authors.lastname: Guzman-Reyes
authors.affiliation: Department of Anesthesiology, University of Texas Medical School at Houston, MSB 5.020, 6431 Fannin Street, Houston, TX, 77030.
authors.forename: Semhar
authors.initials: S
authors.lastname: Ghebremichael
authors.affiliation: Department of Anesthesiology, University of Texas Medical School at Houston, MSB 5.020, 6431 Fannin Street, Houston, TX, 77030.
authors.forename: Srikanth
authors.initials: S
authors.lastname: Sridhar
authors.affiliation: Department of Anesthesiology, University of Texas Medical School at Houston, MSB 5.020, 6431 Fannin Street, Houston, TX, 77030.
authors.forename: Amy D
authors.initials: AD
authors.lastname: Graham-Carlson
authors.affiliation: Department of Anesthesiology, University of Texas Medical School at Houston, MSB 5.020, 6431 Fannin Street, Houston, TX, 77030.
authors.forename: Olga
authors.initials: O
authors.lastname: Pawelek
authors.affiliation: Department of Anesthesiology, University of Texas Medical School at Houston, MSB 5.020, 6431 Fannin Street, Houston, TX, 77030.
authors.forename: Ranu
authors.initials: R
authors.lastname: Jain
authors.affiliation: Department of Anesthesiology, University of Texas Medical School at Houston, MSB 5.020, 6431 Fannin Street, Houston, TX, 77030.
authors.forename: Carin A
authors.initials: CA
authors.lastname: Hagberg
authors.affiliation: Department of Anesthesiology, University of Texas Medical School at Houston, MSB 5.020, 6431 Fannin Street, Houston, TX, 77030. Electronic address: Evan.G.Pivalizza@uth.tmc.edu.
authors.forename: Evan G
authors.initials: EG
authors.lastname: Pivalizza
mesh_terms: D000776:Anesthesiology / Q000193:education*; D002983:Clinical Competence / Q000706:statistics & numerical data*; D004521:Educational Measurement / Q000379:methods* / Q000706:statistics & numerical data*; D005180:Faculty, Medical; D006801:Humans; D007396:Internship and Residency; D015203:Reproducibility of Results; D012189:Retrospective Studies
keywords: Applicant; Faculty; Interview; Reliability; Reproducibility; Resident