Evaluating the effort expended to understand speech in noise using a dual-task paradigm: the effects of providing visual speech cues.
OBJECTIVE
Using a dual-task paradigm, 2 experiments (Experiments 1 and 2) were conducted to assess differences in the amount of listening effort expended to understand speech in noise in audiovisual (AV) and audio-only (A-only) modalities. Experiment 1 had equivalent noise levels in both modalities, and Experiment 2 equated speech recognition performance levels by increasing the noise in the AV versus A-only modality.


METHODS
Sixty adults were randomly assigned to Experiment 1 or Experiment 2. Participants performed speech and tactile recognition tasks separately (single task) and concurrently (dual task). The speech tasks were performed in both modalities. Accuracy and reaction time data were collected as well as ratings of perceived accuracy and effort.


RESULTS
In Experiment 1, the AV modality speech recognition was rated as less effortful, and accuracy scores were higher than A only. In Experiment 2, reaction times were slower, tactile task performance was poorer, and listening effort increased, in the AV versus the A-only modality.


CONCLUSIONS
At equivalent noise levels, speech recognition performance was enhanced and subjectively less effortful in the AV than A-only modality. At equivalent accuracy levels, the dual-task performance decrements (for both tasks) suggest that the noisier AV modality was more effortful than the A-only modality.
Fraser
Sarah
S
Department of Psychology, Concordia University, Center for Research in Human Development, Québec, Canada. sfraser@live.concordia.ca
Gagné
Jean-Pierre
JP
Alepins
Majolaine
M
Dubois
Pascale
P
D000161:Acoustic Stimulation; D000293:Adolescent; D000328:Adult; D001307:Auditory Perception; D005260:Female; D006801:Humans; D008297:Male; D009483:Neuropsychological Tests; D009622:Noise; D046709:Pattern Recognition, Physiological; D010812:Physical Stimulation; D011930:Reaction Time; D013060:Speech; D013067:Speech Perception; D011795:Surveys and Questionnaires; D013647:Task Performance and Analysis; D055698:Touch Perception; D014796:Visual Perception; D055815:Young Adult