title: A comparative assessment and gap analysis of commonly used team rating scales.
abstract: BACKGROUND
  The purpose of this article was to conduct a gap analysis of important team constructs that may be absent in widely used team assessments.
  
  
  METHODS
  Two assessment tools with known validity evidence (1) Non-Technical Skills for Surgeons (NOTSS) and (2) the Cannon-Bowers Scale were used to evaluate 11 teams of surgical residents (n = 33) performing simulated laparoscopic hernia repairs. Faculty raters' scores were used to compare the surveys and assess validity and reliability. Raters' detailed observation notes were used to indicate important behavioral constructs that were missing from the team rating scales.
  
  
  RESULTS
  When assessing inter-item correlations (reliability) four of five NOTSS' scale items had significant correlations (r = 0.9-1.0, P < 0.05) with the Cannon-Bowers items. While the correlations were only noted for three of six Cannon-Bowers items, in each instance the same four of five NOTSS items correlated with the three Cannon-Bowers items, thus providing further validity evidence for both scales. When evaluating the gap, key emerging themes included the need to focus on critical team errors, individual team member contributions, task performance, and overall team performance. These gaps, plus items from the NOTSS and Cannon-Bowers scales, were incorporated into a new rating scale.
  
  
  CONCLUSIONS
  Despite continued evidence of validity and reliability, there were several behavioral constructs that were not represented when using the NOTSS and Cannon-Bowers scales. Critical team errors, individual team member contributions, task performance, and overall team performance appear important in our ability to understand teams and teamwork.
authors.affiliation: Department of Surgery, University of Wisconsin, Madison, Wisconsin. Electronic address: pugh@surgery.wisc.edu.
authors.forename: Carla M
authors.initials: CM
authors.lastname: Pugh
authors.affiliation: Department of Surgery, University of Wisconsin, Madison, Wisconsin.
authors.forename: Elaine R
authors.initials: ER
authors.lastname: Cohen
authors.affiliation: Department of Surgery, University of Wisconsin, Madison, Wisconsin.
authors.forename: Calvin
authors.initials: C
authors.lastname: Kwan
authors.affiliation: Institute for Simulation and Training, University of Central Florida, Orlando, Florida.
authors.forename: Janice A
authors.initials: JA
authors.lastname: Cannon-Bowers
mesh_terms: D001291:Attitude of Health Personnel; D004650:Employee Performance Appraisal; D006801:Humans; D010348:Patient Care Team / Q000592:standards*; D017064:Process Assessment, Health Care; D013043:Specialties, Surgical / Q000592:standards*
keywords: Medical education; Patient safety; Performance assessment; Rating scale; Taskwork; Teamwork