title: Sonification and haptic feedback in addition to visual feedback enhances complex motor task learning.
abstract: Concurrent augmented feedback has been shown to be less effective for learning simple motor tasks than for complex tasks. However, as mostly artificial tasks have been investigated, transfer of results to tasks in sports and rehabilitation remains unknown. Therefore, in this study, the effect of different concurrent feedback was evaluated in trunk-arm rowing. It was then investigated whether multimodal audiovisual and visuohaptic feedback are more effective for learning than visual feedback only. Naïve subjects (N = 24) trained in three groups on a highly realistic virtual reality-based rowing simulator. In the visual feedback group, the subject's oar was superimposed to the target oar, which continuously became more transparent when the deviation between the oars decreased. Moreover, a trace of the subject's trajectory emerged if deviations exceeded a threshold. The audiovisual feedback group trained with oar movement sonification in addition to visual feedback to facilitate learning of the velocity profile. In the visuohaptic group, the oar movement was inhibited by path deviation-dependent braking forces to enhance learning of spatial aspects. All groups significantly decreased the spatial error (tendency in visual group) and velocity error from baseline to the retention tests. Audiovisual feedback fostered learning of the velocity profile significantly more than visuohaptic feedback. The study revealed that well-designed concurrent feedback fosters complex task learning, especially if the advantages of different modalities are exploited. Further studies should analyze the impact of within-feedback design parameters and the transferability of the results to other tasks in sports and rehabilitation.
authors.affiliation: Sensory-Motor Systems (SMS) Lab, Institute of Robotics and Intelligent Systems (IRIS), ETH Zurich, Sonneggstrasse 3 (ML G 57), 8092, Zurich, Switzerland, roland.sigrist@hest.ethz.ch.
authors.forename: Roland
authors.initials: R
authors.lastname: Sigrist
authors.forename: Georg
authors.initials: G
authors.lastname: Rauter
authors.forename: Laura
authors.initials: L
authors.lastname: Marchal-Crespo
authors.forename: Robert
authors.initials: R
authors.lastname: Riener
authors.forename: Peter
authors.initials: P
authors.lastname: Wolf
mesh_terms: D000328:Adult; D001307:Auditory Perception / Q000502:physiology*; D056228:Feedback, Sensory / Q000502:physiology*; D005260:Female; D006801:Humans; D007858:Learning / Q000502:physiology*; D008297:Male; D009048:Motor Skills / Q000502:physiology*; D011597:Psychomotor Performance / Q000502:physiology; D055698:Touch Perception / Q000502:physiology*; D014796:Visual Perception / Q000502:physiology*; D055815:Young Adult