title: Using peers to assess handoffs: a pilot study.
abstract: BACKGROUND
  Handoffs among post-graduate year 1 (PGY1) trainees occur with high frequency. Peer assessment of handoff competence would add a new perspective on how well the handoff information helped them to provide optimal patient care.
  
  
  OBJECTIVE
  The goals of this study were to test the feasibility of the approach of an instrument for peer assessment of handoffs by meeting criteria of being able to use technology to capture evaluations in real time, exhibiting strong psychometric properties, and having high PGY1 satisfaction scores.
  
  
  METHODS
  An iPad® application was built for a seven-item handoff instrument. Over a two-month period, post-call PGY1s completed assessments of three co-PGY1s from whom they received handoffs the prior evening.
  
  
  METHODS
  Internal Medicine PGY1s at the University of Pennsylvania.
  
  
  METHODS
  ANOVA was used to explore interperson score differences (validity). Generalizability analyses provided estimates of score precision (reproducibility). PGY1s completed satisfaction surveys about the process.
  
  
  RESULTS
  Sixty-two PGY1s (100 %) participated in the study. 59 % of the targeted evaluations were completed. The major limitations were network connectivity and inability to find the post-call trainee. PGY1 scores on the single item of "overall competency" ranged from 4 to 9 with a mean of 7.31 (SD 1.09). Generalizability coefficients approached 0.60 for 10 evaluations per PGY1 for a single rotation and 12 evaluations per PGY1 across multiple rotations. The majority of PGY1s believed that they could adequately assess handoff competence and that the peer assessment process was valuable (70 and 77 %, respectively).
  
  
  CONCLUSIONS
  Psychometric properties of an instrument for peer assessment of handoffs are encouraging. Obtaining 10 or 12 evaluations per PGY1 allowed for reliable assessment of handoff skills. Peer evaluations of handoffs using mobile technology were feasible, and were well received by PGY1s.
authors.affiliation: Perelman School of Medicine at the University of Pennsylvania, Pulmonary Penn Lung Cancer, PCAM, 1 West Pavilion 3400 Civic Center Boulevard, Philadelphia, PA 19104, USA. Jessica.dine@uphs.upenn.edu
authors.forename: C Jessica
authors.initials: CJ
authors.lastname: Dine
authors.forename: Nicholas
authors.initials: N
authors.lastname: Wingate
authors.forename: Ilene M
authors.initials: IM
authors.lastname: Rosen
authors.forename: Jennifer S
authors.initials: JS
authors.lastname: Myers
authors.forename: Jennifer
authors.initials: J
authors.lastname: Lapin
authors.forename: Jennifer R
authors.initials: JR
authors.lastname: Kogan
authors.forename: Judy A
authors.initials: JA
authors.lastname: Shea
mesh_terms: D002983:Clinical Competence / Q000592:standards*; D034201:Computers, Handheld / Q000592:standards* / Q000639:trends; D003625:Data Collection / Q000379:methods; D005240:Feasibility Studies; D006801:Humans; D007396:Internship and Residency / Q000379:methods / Q000592:standards* / Q000639:trends; D018024:Peer Review, Health Care / Q000379:methods / Q000592:standards* / Q000639:trends; D010865:Pilot Projects; D011446:Prospective Studies