A first look at the Accreditation Council for Graduate Medical Education anesthesiology milestones: implementation of self-evaluation in a large residency program.
OBJECTIVE
The objective was to determine if there is a correlation between resident postgraduate year (PGY) of training and self-evaluation of performance using the Accreditation Council for Graduate Medical Education milestones.


METHODS
Survey.


METHODS
Residency program at a large academic center.


METHODS
Residents and Faculty Clinical Competency Committee (CCC).


METHODS
None.


METHODS
Resident and CCC milestone scores.


RESULTS
Correlation coefficients for average score for each milestone vs PGY level ranged from 0.80 for receiving and giving feedback to 0.95 for anesthetic choice and conduct. All milestones showed a relatively linear relationship with PGY of training, and none were found to be consistently reached very late or very early in training. When examining variation across the scores for the individual residents, the distributions for PGY-2 and -3 appeared to be wider than those for PGY-1 and -4. The intraclass correlation coefficients ranged from 0.718 to 0.928.


CONCLUSIONS
There was a remarkable degree of consistency in the relationship between level of training and resident self-assessment score for every milestone, as well as strong agreement between the resident and CCC faculty scores. Examination of the variance in the scores, when interpreted in light of our particular training program's characteristics, suggests that the milestones accurately reflect the progression in skill across the residency. In addition, given the concordance between the self-evaluation scores and the CCC faculty scores, self-evaluation may be a reasonable starting point as programs begin the daunting task of determining scores for each of the 25 milestones as part of the biannual evaluation process.
University of Pittsburgh Department of Anesthesiology, 3471 Fifth Ave, Kaufmann Bldg Suite 910, Pittsburgh, PA, 15213. Electronic address: faithjordanross@gmail.com.
Faith J
FJ
Ross
University of Pittsburgh Department of Anesthesiology, 3471 Fifth Ave, Kaufmann Bldg Suite 910, Pittsburgh, PA, 15213. Electronic address: metrodg@anes.upmc.edu.
David G
DG
Metro
University of Pittsburgh Department of Anesthesiology, 3471 Fifth Ave, Kaufmann Bldg Suite 910, Pittsburgh, PA, 15213. Electronic address: beamst@upmc.edu.
Shawn T
ST
Beaman
University of Pittsburgh Department of Anesthesiology, 3471 Fifth Ave, Kaufmann Bldg Suite 910, Pittsburgh, PA, 15213. Electronic address: cainj@upmc.edu.
James G
JG
Cain
University of Pittsburgh Department of Anesthesiology, 3471 Fifth Ave, Kaufmann Bldg Suite 910, Pittsburgh, PA, 15213. Electronic address: Dowdymm@upmc.edu.
Monique M
MM
Dowdy
University of Pittsburgh Graduate School of Public Health, Epidemiology Data Coordinating Center, 130 DeSoto St, 127 Parran Hall, Pittsburgh, PA, 15261. Electronic address: aba44@pitt.edu.
Abraham
A
Apfel
University of Pittsburgh Graduate School of Public Health, Epidemiology Data Coordinating Center, A444 Crabtree, 130 DeSoto St, Pittsburgh, PA, 15261. Electronic address: jjeong@pitt.edu.
Jong-Hyeon
JH
Jeong
University of Pittsburgh Department of Anesthesiology, 3471 Fifth Ave, Kaufmann Bldg Suite 910, Pittsburgh, PA, 15213. Electronic address: ibinsonjw@upmc.edu.
James W
JW
Ibinson
D000068:Accreditation / Q000379:methods*; D000776:Anesthesiology / Q000193:education*; D002983:Clinical Competence; D004503:Education, Medical, Graduate; D004521:Educational Measurement / Q000379:methods; D006801:Humans; D007396:Internship and Residency; D012647:Self-Assessment
Anesthesiology; Milestones; Residency; Self-assessment; Self-evaluation