title: Development of a valid and reliable video-based decision-making test for Australian football umpires.
abstract: OBJECTIVE
  To develop a valid and reliable video-based decision-making test to examine and monitor the decision-making performance of Australian football umpires.
  
  
  METHODS
  Validation assessments with test re-test reliability.
  
  
  METHODS
  A video-based decision-making test was developed from a pool of 156 video-based decision-making situations. Australian football umpires (n=56) and players (n=45) participated in two separate phases of analysis. In phase one, players completed a test re-test reliability assessment with a 100 video-clips. Results indicated 24 clips were a reliable measure of decision-making performance. In phase two, umpires completed a test re-test protocol with 80 clips, 24 of which were the reliable clips identified by the player cohort in phase one. These 24 clips provided a measure of construct validity. Face and content validity were assessed by skill acquisition specialists, expert umpire coaches, and umpires.
  
  
  RESULTS
  From each of phase one and two of the reliability assessment, 24 clips were found to have a kappa value greater than 0.30, providing a total of 48 reliable video-clips. Construct validity was supported, with the umpire group performing significantly better than the player group on the 24 clips presented to both groups on each testing occasion. Face and content validity were also demonstrated.
  
  
  CONCLUSIONS
  This investigation demonstrated the ability prospectively to determine reliability and validity of the video-based decision-making test designed specifically for Australian football umpires. Establishing the validity and reliability of the video clips ensures future investigations can accurately and consistently measure the decision-making performance of Australian football umpires.
authors.affiliation: School of Health Sciences, University of Ballarat, Australia. Electronic address: paul.larkin@sydney.edu.au.
authors.forename: Paul
authors.initials: P
authors.lastname: Larkin
authors.affiliation: School of Health Sciences, University of Ballarat, Australia.
authors.forename: Christopher
authors.initials: C
authors.lastname: Mesagno
authors.affiliation: Institute of Sport, Exercise and Active Living, Victoria University, Australia.
authors.forename: Jason
authors.initials: J
authors.lastname: Berry
authors.affiliation: School of Exercise and Nutrition Sciences, Deakin University, Australia.
authors.forename: Michael
authors.initials: M
authors.lastname: Spittle
mesh_terms: D000328:Adult; D003657:Decision Making; D006801:Humans; D015203:Reproducibility of Results; D012916:Soccer; D014741:Video Recording
keywords: Cognition; Motor skills; Perception; Reliability; Sports officials; Validity