title: Meeting the Accreditation Council for Graduate Medical Education competencies using established residency training program assessment tools.
abstract: BACKGROUND
  Most existing residency evaluation tools were constructed to evaluate the Accreditation Council for Graduate Medical Education (ACGME) competencies.
  
  
  METHODS
  Before ACGME's six competency based assessment requirements for resident performance were developed, we created a residency evaluation tool with 5 domains important to successful surgical resident performance. Reliability was determined after 6 months of use. Factor analysis assessed whether the evaluation tool was a construct-valid measure of the ACGME competencies.
  
  
  RESULTS
  Three hundred forty-three evaluations for 36 surgical residents were tested. The original evaluation tool was highly reliable with an overall reliability of 0.97. Factor analysis defined 4 new combinations of questions analogous to 4 of the ACGME competencies: professionalism (reliability 0.95), patient care (reliability 0.93), medical knowledge (reliability 0.92), and communication (reliability 0.92). The new competency clusters were correlated with each other to a moderate degree.
  
  
  CONCLUSIONS
  Our locally developed tool demonstrated high reliability and construct validity for 4 of 6 ACGME competencies. The correlation between factors suggests overlap between competencies.
authors.affiliation: Department of Surgery, Medical College of Wisconsin, 9200 W. Wisconsin Ave., Milwaukee, WI 53226, USA. kbrasel@mcw.edu
authors.forename: Karen J
authors.initials: KJ
authors.lastname: Brasel
authors.forename: Dawn
authors.initials: D
authors.lastname: Bragg
authors.forename: Deborah E
authors.initials: DE
authors.lastname: Simpson
authors.forename: John A
authors.initials: JA
authors.lastname: Weigelt
mesh_terms: D000068:Accreditation / Q000592:standards*; D002983:Clinical Competence; D004521:Educational Measurement / Q000379:methods*; D005163:Factor Analysis, Statistical; D013502:General Surgery / Q000193:education*; D006801:Humans; D007396:Internship and Residency; D015203:Reproducibility of Results; D014481:United States