title: Expert validation of a teamwork assessment rubric: A modified Delphi study.
abstract: BACKGROUND
  Teamwork is a 'soft skill' employability competence desired by employers. Poor teamwork skills in healthcare have an impact on adverse outcomes. Teamwork skills are rarely the focus of teaching and assessment in undergraduate courses. The TeamUP Rubric is a tool used to teach and evaluate undergraduate students' teamwork skills. Students also use the rubric to give anonymised peer feedback during team-based academic assignments. The rubric's five domains focus on planning, environment, facilitation, conflict management and individual contribution; each domain is grounded in relevant theory. Students earn marks for their teamwork skills; validity of the assessment rubric is critical.
  
  
  OBJECTIVE
  To what extent do experts agree that the TeamUP Rubric is a valid assessment of 'teamwork skills'?
  
  
  METHODS
  Modified Delphi technique incorporating Feminist Collaborative Conversations.
  
  
  METHODS
  A heterogeneous panel of 35 professionals with recognised expertise in communications and/or teamwork.
  
  
  METHODS
  Three Delphi rounds using a survey that included the rubric were conducted either face-to-face, by telephone or online. Quantitative analysis yielded item content validity indices (I-CVI); minimum consensus was pre-set at 70%. An average of the I-CVI also yielded sub-scale (domain) (D-CVI/Ave) and scale content validity indices (S-CVI/Ave). After each Delphi round, qualitative data were analysed and interpreted; Feminist Collaborative Conversations by the research team aimed to clarify and confirm consensus about the wording of items on the rubric.
  
  
  RESULTS
  Consensus (at 70%) was obtained for all but one behavioural descriptor of the rubric. We modified that descriptor to address expert concerns. The TeamUP Rubric (Version 4) can be considered to be well validated at that level of consensus. The final rubric reflects underpinning theory, with no areas of conceptual overlap between rubric domains.
  
  
  CONCLUSIONS
  The final TeamUP Rubric arising from this study validly measures individual student teamwork skills and can be used with confidence in the university setting.
authors.affiliation: School of Health and Human Sciences, Southern Cross University, Locked Mail Bag 4, Coolangatta, QLD 4225 Australia. Electronic address: jennifer.parratt@scu.edu.au.
authors.forename: Jenny A
authors.initials: JA
authors.lastname: Parratt
authors.affiliation: School of Health and Human Sciences, Southern Cross University, Locked Mail Bag 4, Coolangatta, QLD 4225 Australia.
authors.forename: Kathleen M
authors.initials: KM
authors.lastname: Fahy
authors.affiliation: School of Health and Human Sciences, Southern Cross University, PO Box 157, Lismore, NSW 2480, Australia.
authors.forename: Marie
authors.initials: M
authors.lastname: Hutchinson
authors.affiliation: School of Natural Sciences, Griffith University, 170 Kessels Road, Nathan, QLD 4111 Australia.
authors.forename: Gui
authors.initials: G
authors.lastname: Lohmann
authors.affiliation: School of Health and Human Sciences, Southern Cross University, Locked Mail Bag 4, Coolangatta, QLD 4225 Australia.
authors.forename: Carolyn R
authors.initials: CR
authors.lastname: Hastie
authors.affiliation: Centre for Children and Young People, School of Education, Southern Cross University, PO Box 157, Lismore, NSW 2480, Australia.
authors.forename: Marilyn
authors.initials: M
authors.lastname: Chaseling
authors.affiliation: National Institute of Integrative Medicine, 11-23 Burwood Rd., Hawthorn, VIC, Australia.
authors.forename: Kylie
authors.initials: K
authors.lastname: O'Brien
mesh_terms: D003299:Cooperative Behavior; D003697:Delphi Technique; D007398:Interpersonal Relations; D007400:Interprofessional Relations
keywords: Educational assessment; Expert opinion; Modified Delphi technique; Rubric; Teamwork; Undergraduate; Validation study