Evaluating the performance of medical educators: a novel analysis tool to demonstrate the quality and impact of educational activities.
OBJECTIVE
Traditional promotion standards rely heavily on quantification of research grants and publications in the curriculum vitae. The promotion and retention of educators is challenged by the lack of accepted standards to evaluate the depth, breadth, quality, and impact of educational activities. The authors sought to develop a practical analysis tool for the evaluation of educator portfolios (EPs), based on measurable outcomes that allow reproducible analysis of the quality and impact of educational activities.


METHODS
The authors, 10 veteran educators and an external expert evaluator, used a scholarly, iterative consensus-building process to develop the tool and test it using real EPs from educational scholars who followed an EP template. They revised the template in parallel with the analysis tool to ensure that EP data enabled valid and reliable evaluation. The authors created the EP template and analysis tool for scholar and program evaluation in the Educational Scholars Program, a three-year national certification program of the Academic Pediatric Association.


RESULTS
The analysis tool combines 18 quantitative and 25 qualitative items, with specifications, for objective evaluation of educational activities and scholarship.


CONCLUSIONS
The authors offer this comprehensive, yet practical tool as a method to enhance opportunities for faculty promotions and advancement, based on well-defined and documented educational outcome measures. It is relevant for clinical educators across disciplines and across institutions. Future studies will test the interrater reliability of the tool, using data from EPs written using the revised template.
Chandran
Latha
L
Department of Pediatrics, HSC T11-020, Stony Brook UniversityMedical Center, Stony Brook, NY 11794-8111, USA. latha.chandran@stonybrook.edu
Gusic
Maryellen
M
Baldwin
Constance
C
Turner
Teri
T
Zenni
Elisa
E
Lane
J Lindsey
JL
Balmer
Dorene
D
Bar-On
Miriam
M
Rauch
Daniel A
DA
Indyk
Diane
D
Gruppen
Larry D
LD
D004501:Education, Medical / Q000592:standards*; D004521:Educational Measurement / Q000379:methods*; D005180:Faculty, Medical / Q000458:organization & administration*; D006801:Humans; D015397:Program Evaluation; D013192:Staff Development / Q000379:methods*; D014481:United States