title: Validation of a tool to measure and promote clinical teamwork.
abstract: OBJECTIVE
  Human factors and teamwork are major contributors to sentinel events. A major limitation to improving human factors and teamwork is the paucity of objective validated measurement tools. Our goal was to develop a brief tool that could be used to objectively evaluate teamwork in the field during short clinical team simulations and in everyday clinical care.
  
  
  METHODS
  A pilot validation study. Standardized videos were created demonstrating poor, average, and excellent teamwork among an obstetric team in a common clinical scenario (shoulder dystocia). Three evaluators all trained in Crew Resource Management, and unaware of assigned teamwork level, independently reviewed videos and evaluated teamwork using the Clinical Teamwork Scale (CTS). Statistical analysis included calculation of the Kappa statistic and Kendall coefficient to evaluate agreement and score concordance among raters, and Interclass Correlation Coefficient (ICC) to evaluate interrater reliability. The reliability of the tool was further evaluated by estimating the variance of each component of the tool based on generalizability theory.
  
  
  RESULTS
  There was substantial agreement (Kappa 0.78) and score concordance (Kendall coefficient 0.95) among raters, and excellent interrater reliability (interclass correlation coefficient 0.98). The highest percentage of variance in scores among raters was because of rater/item interaction.
  
  
  CONCLUSIONS
  The CTS was developed to efficiently measure key clinical teamwork skills during simulation exercises and in everyday clinical care. It contains 15 questions in 5 clinical teamwork domains (communication, situational awareness, decision-making, role responsibility, and patient friendliness). It is easy to use and has construct validity with median ratings consistently corresponding with the intended teamwork level. The CTS is a brief, straightforward, valid, reliable, and easy-to-use tool to measure key factors in teamwork in simulated and clinical settings.
authors.affiliation: Medical Informatics and Clinical Epidemiology, and Public Health & Preventive Medicine, Oregon Health & Science University, Portland, OR 97239-3098, USA. guisej@ohsu.edu
authors.forename: Jeanne-Marie
authors.initials: JM
authors.lastname: Guise
authors.forename: Shad H
authors.initials: SH
authors.lastname: Deering
authors.forename: Barbara G
authors.initials: BG
authors.lastname: Kanki
authors.forename: Patricia
authors.initials: P
authors.lastname: Osterweil
authors.forename: Hong
authors.initials: H
authors.lastname: Li
authors.forename: Motomi
authors.initials: M
authors.lastname: Mori
authors.forename: Nancy K
authors.initials: NK
authors.lastname: Lowe
mesh_terms: D002983:Clinical Competence; D004526:Efficiency; D017598:Efficiency, Organizational; D006305:Health Status Indicators; D006801:Humans; D010348:Patient Care Team; D016544:Patient Simulation; D010865:Pilot Projects; D011787:Quality of Health Care; D015203:Reproducibility of Results; D013223:Statistics as Topic; D014741:Video Recording