title: Evaluation of the team performance observation tool with targeted behavioral markers in simulation-based interprofessional education.
abstract: The primary aim of this study was to decrease the subjectivity of the Team Performance Observation Tool (TPOT) and determine the psychometric properties of this tool when using scenario-specific targeted behavioral markers (TBMs). We used a convenience sample of 47 physical therapy and 25 nursing students at an academic medical center who were organized in interprofessional teams of three to care for a simulated patient. The TPOT demonstrated satisfactory validity and reliability with the use of TBMs. We demonstrated significant correlations between the TPOT overall rating and two scenario-specific outcomes: (1) a negative correlation between the TPOT overall rating and the number of medical errors committed by the 24 teams (r = -0.531, p = 0.008) and (2) a positive correlation between the TPOT overall rating and a time-based functional outcome (r = 0.803, p < 0.001). We demonstrated substantial test-retest reliability (kappa = 0.707, p < 0.001), inter-rater reliability (kappa = 0.730), and good internal consistency reliability (Cronbach's α = 0.921). The results of our study support the use of scenario-specific TBMs to enhance the reliability and validity of the TPOT for use in the evaluation of team-based simulation scenarios. Further evaluation of the TPOT with TBMs from other simulation and training contexts is warranted.
authors.affiliation: College of Nursing, University of Nebraska Medical Center , Omaha, NE , USA .
authors.forename: Chao
authors.initials: C
authors.lastname: Zhang
authors.forename: Connie
authors.initials: C
authors.lastname: Miller
authors.forename: Kathleen
authors.initials: K
authors.lastname: Volkman
authors.forename: Jane
authors.initials: J
authors.lastname: Meza
authors.forename: Katherine
authors.initials: K
authors.lastname: Jones
mesh_terms: D000046:Academic Medical Centers; D001519:Behavior; D000070642:Brain Injuries, Traumatic / Q000451:nursing / Q000534:rehabilitation; D002983:Clinical Competence / Q000592:standards; D004521:Educational Measurement / Q000379:methods*; D007722:Health Knowledge, Attitudes, Practice; D006801:Humans; D007400:Interprofessional Relations; D015588:Observer Variation; D010348:Patient Care Team / Q000458:organization & administration* / Q000592:standards; D016544:Patient Simulation; D059825:Physical Therapists / Q000193:education*; D011594:Psychometrics; D015203:Reproducibility of Results; D013338:Students, Nursing / Q000523:psychology*
keywords: Interprofessional education; Team Performance Observation Tool; simulation; targeted behavioral markers; teamwork