title: Using video ratings to assess multitasking performance in a naturalistic paradigm.
abstract: BACKGROUND
  Multitasking measures, in which a series of tasks must be completed within a naturalistic setting not fully under the experimenter's control, have been shown to be more sensitive than traditional measures in detecting organisational problems in people with difficulties in executive functioning. There are a number of drawbacks to such tasks however. They can take considerable time to administer and are demanding in terms of examiners noting and recording all relevant aspects of performance. This potentially leaves them more open to subtle bias. One method that could offset these limitations is to video record performance.
  
  
  OBJECTIVE
  The practicality and outcome of using video ratings to accurately score performance off-line is investigated here.
  
  
  METHODS
  Nineteen participants completed a Multiple Errands Task (MET) while wearing a body-worn camera. Their performance was scored "live" and by an independent rater who had only access to video footage of the task.
  
  
  RESULTS
  Significant relationships were seen on all variables of the MET between the live and video ratings. The inter-rater reliability of the measure appears strong.
  
  
  CONCLUSIONS
  We provide initial support for the use of a video rater when assessing performance on an MET.
authors.affiliation: Dementia Research Centre, North East London NHS Foundation Trust, London, UK MRC Cognition and Brain Sciences Unit, Cambridge, UK.
authors.forename: S M
authors.initials: SM
authors.lastname: Hynes
authors.affiliation: King's College London, Institute of Psychiatry, Psychology & Neuroscience, Department of Psychology, North East London NHS Foundation Trust, London, UK MRC Cognition and Brain Sciences Unit, Cambridge, UK.
authors.forename: J
authors.initials: J
authors.lastname: Fish
authors.affiliation: MRC Cognition and Brain Sciences Unit, Cambridge, UK.
authors.forename: T
authors.initials: T
authors.lastname: Manly
mesh_terms: D000328:Adult; D005260:Female; D006801:Humans; D008297:Male; D015588:Observer Variation; D011597:Psychomotor Performance; D012046:Rehabilitation / Q000295:instrumentation / Q000379:methods*; D015203:Reproducibility of Results; D016896:Treatment Outcome; D014741:Video Recording / Q000295:instrumentation / Q000379:methods*; D055815:Young Adult
keywords: Rehabilitation; assessment; executive function; memory; neurorehabilitation; therapy