title: Evaluating the performance of medical educators: a novel analysis tool to demonstrate the quality and impact of educational activities.
abstract: OBJECTIVE
  Traditional promotion standards rely heavily on quantification of research grants and publications in the curriculum vitae. The promotion and retention of educators is challenged by the lack of accepted standards to evaluate the depth, breadth, quality, and impact of educational activities. The authors sought to develop a practical analysis tool for the evaluation of educator portfolios (EPs), based on measurable outcomes that allow reproducible analysis of the quality and impact of educational activities.
  
  
  METHODS
  The authors, 10 veteran educators and an external expert evaluator, used a scholarly, iterative consensus-building process to develop the tool and test it using real EPs from educational scholars who followed an EP template. They revised the template in parallel with the analysis tool to ensure that EP data enabled valid and reliable evaluation. The authors created the EP template and analysis tool for scholar and program evaluation in the Educational Scholars Program, a three-year national certification program of the Academic Pediatric Association.
  
  
  RESULTS
  The analysis tool combines 18 quantitative and 25 qualitative items, with specifications, for objective evaluation of educational activities and scholarship.
  
  
  CONCLUSIONS
  The authors offer this comprehensive, yet practical tool as a method to enhance opportunities for faculty promotions and advancement, based on well-defined and documented educational outcome measures. It is relevant for clinical educators across disciplines and across institutions. Future studies will test the interrater reliability of the tool, using data from EPs written using the revised template.
authors.affiliation: Department of Pediatrics, HSC T11-020, Stony Brook UniversityMedical Center, Stony Brook, NY 11794-8111, USA. latha.chandran@stonybrook.edu
authors.forename: Latha
authors.initials: L
authors.lastname: Chandran
authors.forename: Maryellen
authors.initials: M
authors.lastname: Gusic
authors.forename: Constance
authors.initials: C
authors.lastname: Baldwin
authors.forename: Teri
authors.initials: T
authors.lastname: Turner
authors.forename: Elisa
authors.initials: E
authors.lastname: Zenni
authors.forename: J Lindsey
authors.initials: JL
authors.lastname: Lane
authors.forename: Dorene
authors.initials: D
authors.lastname: Balmer
authors.forename: Miriam
authors.initials: M
authors.lastname: Bar-On
authors.forename: Daniel A
authors.initials: DA
authors.lastname: Rauch
authors.forename: Diane
authors.initials: D
authors.lastname: Indyk
authors.forename: Larry D
authors.initials: LD
authors.lastname: Gruppen
mesh_terms: D004501:Education, Medical / Q000592:standards*; D004521:Educational Measurement / Q000379:methods*; D005180:Faculty, Medical / Q000458:organization & administration*; D006801:Humans; D015397:Program Evaluation; D013192:Staff Development / Q000379:methods*; D014481:United States