title: Objective fidelity evaluation in multisensory virtual environments: auditory cue fidelity in flight simulation.
abstract: We argue that objective fidelity evaluation of virtual environments, such as flight simulation, should be human-performance-centred and task-specific rather than measure the match between simulation and physical reality. We show how principled experimental paradigms and behavioural models to quantify human performance in simulated environments that have emerged from research in multisensory perception provide a framework for the objective evaluation of the contribution of individual cues to human performance measures of fidelity. We present three examples in a flight simulation environment as a case study: Experiment 1: Detection and categorisation of auditory and kinematic motion cues; Experiment 2: Performance evaluation in a target-tracking task; Experiment 3: Transferrable learning of auditory motion cues. We show how the contribution of individual cues to human performance can be robustly evaluated for each task and that the contribution is highly task dependent. The same auditory cues that can be discriminated and are optimally integrated in experiment 1, do not contribute to target-tracking performance in an in-flight refuelling simulation without training, experiment 2. In experiment 3, however, we demonstrate that the auditory cue leads to significant, transferrable, performance improvements with training. We conclude that objective fidelity evaluation requires a task-specific analysis of the contribution of individual cues.
authors.affiliation: Department of Experimental Psychology, Liverpool University, Liverpool, United Kingdom. georg@liv.ac.uk
authors.forename: Georg F
authors.initials: GF
authors.lastname: Meyer
authors.forename: Li Ting
authors.initials: LT
authors.lastname: Wong
authors.forename: Emma
authors.initials: E
authors.lastname: Timson
authors.forename: Philip
authors.initials: P
authors.lastname: Perfect
authors.forename: Mark D
authors.initials: MD
authors.lastname: White
mesh_terms: D000328:Adult; D001307:Auditory Perception / Q000502:physiology*; D001359:Aviation / Q000379:methods*; D001696:Biomechanical Phenomena; D003198:Computer Simulation; D003463:Cues; D005260:Female; D006801:Humans; D008297:Male; D008875:Middle Aged; D015233:Models, Statistical; D009038:Motion; D009949:Orientation; D010364:Pattern Recognition, Visual; D011930:Reaction Time; D015203:Reproducibility of Results; D014584:User-Computer Interface; D014796:Visual Perception / Q000502:physiology*