Evaluating faculty development outcomes by using curriculum vitae analysis.
OBJECTIVE
Many faculty development (FD) programs depend on external private and public sponsors that routinely require systematic studies on FD outcomes. The results of evaluation studies can influence whether or not programs continue to be funded. To better evaluate program outcomes on academic productivity, this paper presents and illustrates an evaluation method that uses the curricula vitae (CVs) of FD program graduates.


METHODS
The evaluation method is implemented by first preparing a record-review template of coding categories that is applied to FD graduates' updated CVs. Next, semi-structured interviews are held with subjects to resolve uncertain CV codes. Finally, coded data are entered into standardized forms and analyzed to yield descriptive findings. The method was piloted with two groups of FD graduates (n = 17) to determine its utility and limitations.


RESULTS
Results show excellent inter-rater reliability (Cohen's Kappa = .79). There was an overall increase in productivity, measured by the CV, during and after the FD program.


CONCLUSIONS
CV analysis can be a useful method for assessing FD program outcomes. Several limitations of the method, such as incomplete CVs and self-report bias, must be considered.
Morzinski
J A
JA
Department of Family and Community Medicine, Medical College of Wisconsin, USA. jmorzins@mcw.edu
Schubot
D B
DB
D015331:Cohort Studies; D004502:Education, Medical, Continuing; D005180:Faculty, Medical; D005194:Family Practice / Q000193:education; D006801:Humans; D007586:Job Application; D010865:Pilot Projects; D011361:Professional Competence; D015397:Program Evaluation / Q000379:methods*; D013192:Staff Development