title: Assessing achievement in nephrology training: using clinic chart audits to quantitatively screen competency.
abstract: BACKGROUND
  Entrustable professional activities (EPAs) are complex tasks representing vital physician functions in multiple competencies, used to demonstrate trainee development along milestones. Managing a nephrology outpatient clinic has been proposed as an EPA for nephrology fellowship training.
  
  
  METHODS
  Retrospective cohort study of nephrology fellow outpatient clinic performance using a previously validated chart audit tool.
  
  
  METHODS
  Outpatient encounter chart audits for training years 2008-2009 through 2012-2013, corresponding to participation in the Nephrology In-Training Examination (ITE). A median of 7 auditors (attending nephrologists) audited a mean of 1,686±408 (SD) charts per year. 18 fellows were audited; 12, in both of their training years.
  
  
  METHODS
  Proportion of chart audit and quality indicator deficiencies.
  
  
  RESULTS
  Longitudinal deficiency and ITE performance.
  
  
  RESULTS
  Among fellows audited in both their training years, chart audit deficiencies were fewer in the second versus the first year (5.4%±2.0% vs 17.3%±7.0%; P<0.001) and declined between the first and second halves of the first year (22.2%±6.4% vs 12.3%±9.5%; P=0.002). Most deficiencies were omission errors, regardless of training year. Quality indicator deficiencies for hypertension and chronic kidney disease-associated anemia recognition and management were fewer during the second year (P<0.001). Yearly audit deficiencies ≥5% were associated with an ITE score less than the 25th percentile for second-year fellows (P=0.03), with no significant association for first-year fellows. Auditor-reported deficiencies declined between the first and second halves of the year (17.0% vs 11.1%; P<0.001), with a stable positive/neutral comment rate (17.3% vs 17.8%; P=0.6), suggesting that the decline was not due to auditor fatigue.
  
  
  CONCLUSIONS
  Retrospective design and small trainee numbers.
  
  
  CONCLUSIONS
  Managing a nephrology outpatient clinic is an EPA. The chart audit tool was used to assess longitudinal fellow performance in managing a nephrology outpatient clinic. Failure to progress may be quantitatively identified and remediated. The tool identifies deficiencies in all 6 competencies, not just medical knowledge, the primary focus of the ITE and the nephrology subspecialty board examination.
authors.affiliation: Nephrology Service, Department of Medicine, Walter Reed National Military Medical Center, Bethesda, MD. Electronic address: christina.m.yuan@health.mil.
authors.forename: Christina M
authors.initials: CM
authors.lastname: Yuan
authors.affiliation: Nephrology Service, Department of Medicine, Walter Reed National Military Medical Center, Bethesda, MD.
authors.forename: Lisa K
authors.initials: LK
authors.lastname: Prince
authors.affiliation: Nephrology Service, Department of Medicine, Walter Reed National Military Medical Center, Bethesda, MD.
authors.forename: Amy J
authors.initials: AJ
authors.lastname: Zwettler
authors.affiliation: Nephrology Service, Department of Medicine, Walter Reed National Military Medical Center, Bethesda, MD.
authors.forename: Robert
authors.initials: R
authors.lastname: Nee
authors.affiliation: Nephrology Service, Department of Medicine, Walter Reed National Military Medical Center, Bethesda, MD.
authors.forename: James D
authors.initials: JD
authors.lastname: Oliver
authors.affiliation: Nephrology Service, Department of Medicine, Walter Reed National Military Medical Center, Bethesda, MD.
authors.forename: Kevin C
authors.initials: KC
authors.lastname: Abbott
mesh_terms: D000124:Achievement; D054869:Clinical Audit / Q000379:methods / Q000592:standards*; D002983:Clinical Competence / Q000592:standards*; D015331:Cohort Studies; D006801:Humans; D007396:Internship and Residency / Q000592:standards*; D009398:Nephrology / Q000193:education* / Q000592:standards*; D010044:Outpatient Clinics, Hospital / Q000592:standards; D012189:Retrospective Studies
keywords: Chart audit; competencies; educational outcomes; entrustable professional activities (EPAs); fellowship; graduate medical education; milestones; nephrology; training programs