title: How Effective are New Milestones Assessments at Demonstrating Resident Growth? 1 Year of Data.
abstract: OBJECTIVE
  Assessment tools that accrue data for the Accreditation Council for Graduate Medical Education Milestones must evaluate residents across multiple dimensions, including medical knowledge, procedural skills, teaching, and professionalism. Our objectives were to: (1) develop an assessment tool to evaluate resident performance in accordance with the Milestones and (2) review trends in resident achievements during the inaugural year of Milestone implementation.
  
  
  METHODS
  A novel venue and postgraduate year (PGY) specific assessment tool was built, tested, and implemented for both operating room and labor and delivery "venues." Resident development of competence and independence was captured over time. To account for variable rotation schedules, the year was divided into thirds and compared using two-tailed Fisher's exact test.
  
  
  METHODS
  Brigham and Women's and Massachusetts General Hospitals, Boston MA.
  
  
  METHODS
  Faculty evaluators and obstetrics and gynecology residents.
  
  
  RESULTS
  A total of 822 assessments of 44 residents were completed between 9/2014 and 6/2015. The percentage of labor and delivery tasks completed "independently" increased monotonically across the start of all years: 8.4% for PGY-1, 60.3% for PGY-2, 73.7% for PGY-3, and 87.5% for PGY-4. Assessments of PGY-1 residents demonstrated a significant shift toward "with minimal supervision" and "independent" for the management of normal labor (p = 0.03). PGY-3 residents demonstrated an increase in "able to be primary surgeon" in the operating room, from 36% of the time in the first 2/3 of the year, to 62.3% in the last 1/3 (p < 0.01).
  
  
  CONCLUSIONS
  Assessment tools developed to assist with Milestone assignments capture the growth of residents over time and demonstrate quantifiable differences in achievements between PGY classes. These tools will allow for targeted teaching opportunities for both individual residents and residency programs.
authors.affiliation: Department of Obstetrics, Gynecology and Reproductive Biology, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts. Electronic address: rhgoldman@partners.org.
authors.forename: Randi H
authors.initials: RH
authors.lastname: Goldman
authors.affiliation: Department of Obstetrics, Gynecology and Reproductive Biology, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts; Vincent Department of Obstetrics and Gynecology, Massachusetts General Hospital, Harvard Medical School, Boston, Massachusetts.
authors.forename: Ruth E
authors.initials: RE
authors.lastname: Tuomala
authors.affiliation: Department of Obstetrics, Gynecology and Reproductive Biology, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts.
authors.forename: Joan M
authors.initials: JM
authors.lastname: Bengtson
authors.affiliation: Vincent Department of Obstetrics and Gynecology, Massachusetts General Hospital, Harvard Medical School, Boston, Massachusetts.
authors.forename: Amy R
authors.initials: AR
authors.lastname: Stagg
mesh_terms: D000068:Accreditation; D000328:Adult; D002983:Clinical Competence; D015331:Cohort Studies; D003162:Competency-Based Education / Q000458:organization & administration; D003430:Cross-Sectional Studies; D003479:Curriculum; D004503:Education, Medical, Graduate / Q000458:organization & administration; D004521:Educational Measurement; D005180:Faculty, Medical; D005260:Female; D006176:Gynecology / Q000193:education*; D006785:Hospitals, University; D006801:Humans; D033183:Interdisciplinary Communication; D007396:Internship and Residency / Q000458:organization & administration*; D007398:Interpersonal Relations; D008297:Male; D008404:Massachusetts; D009774:Obstetrics / Q000193:education*; D015397:Program Evaluation; D013997:Time Factors
keywords: ACGME milestones; Interpersonal and Communication Skills; Medical Knowledge; Patient Care; Practice-Based Learning and Improvement; Professionalism; competency; evaluation tool; obstetrics and gynecology; resident assessment