Aging, audiovisual integration, and the principle of inverse effectiveness.
OBJECTIVE
The purpose of this investigation was to compare the ability of young and older adults to integrate auditory and visual sentence materials under conditions of good and poor signal clarity. The principle of inverse effectiveness (PoIE), which characterizes many neuronal and behavioral phenomena related to multisensory integration, asserts that as unimodal performance declines, integration is enhanced. Thus, the PoIE predicts that both young and older adults will show enhanced integration of auditory and visual speech stimuli when these stimuli are degraded. More importantly, because older adults' unimodal speech recognition skills decline in both the auditory and visual domains, the PoIE predicts that older adults will show enhanced integration during audiovisual speech recognition relative to younger adults. This study provides a test of these predictions.


METHODS
Fifty-three young and 53 older adults with normal hearing completed the closed-set Build-A-Sentence test and the CUNY Sentence test in a total of eight conditions; four unimodal and four audiovisual. In the unimodal conditions, stimuli were either auditory or visual and either easier or harder to perceive; the audiovisual conditions were formed from all the combinations of the unimodal signals. The hard visual signals were created by degrading video contrast, and the hard auditory signals were created by decreasing the signal to noise ratio. Scores from the unimodal and bimodal conditions were used to compute auditory enhancement and integration enhancement measures.


RESULTS
Contrary to the PoIE, neither the auditory enhancement nor integration enhancement measures increased when signal clarity in the auditory or visual channel of audiovisual speech stimuli was decreased, nor was either measure higher for older adults than for young adults. In audiovisual conditions with easy visual stimuli, the integration enhancement measure for older adults was equivalent to that for young adults. However, in conditions with hard visual stimuli, integration enhancement for older adults was significantly lower than that for young adults.


CONCLUSIONS
The present findings do not support extension of the PoIE to audiovisual speech recognition. Our results are not consistent with either the prediction that integration would be enhanced under conditions of poor signal clarity or the prediction that older adults would show enhanced integration, relative to young adults. Although there is a considerable controversy with regard to the best way to measure audiovisual integration, the fact that two of the most prominent measures, auditory enhancement and integration enhancement, both yielded results inconsistent with the PoIE, strongly suggests that the integration of audiovisual speech stimuli differs in some fundamental way from the integration of other bimodal stimuli. The results also suggest that aging does not impair integration enhancement when the visual speech signal has good clarity, but may affect it when the visual speech signal has poor clarity.
Tye-Murray
Nancy
N
Department of Otolaryngology, Washington University School of Medicine, St. Louis, Missouri 63124, USA. murrayn@ent.wustl.edu
Sommers
Mitchell
M
Spehar
Brent
B
Myerson
Joel
J
Hale
Sandra
S
D000161:Acoustic Stimulation; D000293:Adolescent; D000328:Adult; D000368:Aged; D000369:Aged, 80 and over; D000375:Aging / Q000502:physiology*; D006801:Humans; D008085:Lipreading; D010775:Photic Stimulation; D011304:Presbycusis / Q000503:physiopathology*; D011571:Psychoacoustics; D013067:Speech Perception / Q000502:physiology*; D014796:Visual Perception / Q000502:physiology*; D055815:Young Adult
Nature. 1976 Dec 23-30;264(5588):746-8
1012311
Ear Hear. 2002 Oct;23(5):439-49
12411777
Ear Hear. 2005 Jun;26(3):263-75
15937408
Audiology. 1991;30(4):201-11
1755749
Acta Otolaryngol Suppl. 1990;476:127-30
2087952
Neuron. 2007 Jan 18;53(2):279-92
17224408
Int J Audiol. 2008 Nov;47 Suppl 2:S31-7
19012110
J Am Acad Audiol. 1998 Jun;9(3):234-42
9644622
Psychon Bull Rev. 2003 Mar;10(1):224-37
12747512
Brain Topogr. 2009 May;21(3-4):168-76
19404728
J Gerontol B Psychol Sci Soc Sci. 1995 Jul;50(4):P202-11
7606531
J Speech Hear Res. 1985 Sep;28(3):455-62
4046587
Neuropsychologia. 2008 Aug;46(10):2556-62
18490033
J Speech Hear Res. 1986 Dec;29(4):434-46
3795886
J Acoust Soc Am. 2000 Aug;108(2):784-9
10955645
Ear Hear. 2011 Sep-Oct;32(5):650-5
21478751
Cereb Cortex. 2007 May;17(5):1147-53
16785256
Trends Amplif. 2007 Dec;11(4):233-41
18003867
Neurobiol Aging. 2006 Aug;27(8):1155-63
16039016
J Acoust Soc Am. 2002 Jul;112(1):30-3
12141356
J Acoust Soc Am. 1998 May;103(5 Pt 1):2677-90
9604361