title: Validity and Reliability of a Tool to Assess Quality Improvement Knowledge and Skills in Pediatrics Residents.
abstract: BACKGROUND
  Residency programs are expected to educate residents in quality improvement (QI). Effective assessments are needed to ensure residents gain QI knowledge and skills. Limitations of current tools include poor interrater reliability and requirement for scorer training.
  
  
  OBJECTIVE
  To provide evidence for the validity of the Assessment of Quality Improvement Knowledge and Skills (AQIKS), which is a new tool that provides a summative assessment of pediatrics residents' ability to recall QI concepts and apply them to a clinical scenario.
  
  
  METHODS
  We conducted a quasi-experimental study to measure the AQIKS performance in 2 groups of pediatrics residents: postgraduate year (PGY) 2 residents who participated in a 1-year longitudinal QI curriculum, and a concurrent control group of PGY-1 residents who received no formal QI training. The curriculum included 20 hours of didactics and participation in a resident-led QI project. Three faculty members with clinical QI experience, who were not involved in the curriculum and received no additional training, scored the AQIKS.
  
  
  RESULTS
  Complete data were obtained for 30 of 37 residents (81%) in the intervention group, and 36 of 40 residents (90%) in the control group. After completing a QI curriculum, the intervention group's mean score was 40% higher than at baseline (P< .001), while the control group showed no improvement (P= .29). Interrater reliability was substantial (κ= 0.74).
  
  
  CONCLUSIONS
  The AQIKS detects an increase in QI knowledge and skills among pediatrics residents who participated in a QI curriculum, with better interrater reliability than currently available assessment tools.
authors.forename: Stephanie K
authors.initials: SK
authors.lastname: Doupnik
authors.forename: Sonja I
authors.initials: SI
authors.lastname: Ziniel
authors.forename: Eric W
authors.initials: EW
authors.lastname: Glissmeyer
authors.forename: James M
authors.initials: JM
authors.lastname: Moses
mesh_terms: D003479:Curriculum; D004503:Education, Medical, Graduate / Q000379:methods*; D004521:Educational Measurement / Q000379:methods*; D006801:Humans; D007396:Internship and Residency / Q000379:methods*; D010372:Pediatrics / Q000193:education*; D015397:Program Evaluation / Q000379:methods; D058996:Quality Improvement