title: How can audiovisual pathways enhance the temporal resolution of time-compressed speech in blind subjects?
abstract: In blind people, the visual channel cannot assist face-to-face communication via lipreading or visual prosody. Nevertheless, the visual system may enhance the evaluation of auditory information due to its cross-links to (1) the auditory system, (2) supramodal representations, and (3) frontal action-related areas. Apart from feedback or top-down support of, for example, the processing of spatial or phonological representations, experimental data have shown that the visual system can impact auditory perception at more basic computational stages such as temporal signal resolution. For example, blind as compared to sighted subjects are more resistant against backward masking, and this ability appears to be associated with activity in visual cortex. Regarding the comprehension of continuous speech, blind subjects can learn to use accelerated text-to-speech systems for "reading" texts at ultra-fast speaking rates (>16 syllables/s), exceeding by far the normal range of 6 syllables/s. A functional magnetic resonance imaging study has shown that this ability, among other brain regions, significantly covaries with BOLD responses in bilateral pulvinar, right visual cortex, and left supplementary motor area. Furthermore, magnetoencephalographic measurements revealed a particular component in right occipital cortex phase-locked to the syllable onsets of accelerated speech. In sighted people, the "bottleneck" for understanding time-compressed speech seems related to higher demands for buffering phonological material and is, presumably, linked to frontal brain structures. On the other hand, the neurophysiological correlates of functions overcoming this bottleneck, seem to depend upon early visual cortex activity. The present Hypothesis and Theory paper outlines a model that aims at binding these data together, based on early cross-modal pathways that are already known from various audiovisual experiments on cross-modal adjustments during space, time, and object recognition.
authors: Department of General Neurology, Center of Neurology, Hertie Institute for Clinical Brain Research, University of Tübingen Tübingen, Germany.
authors: Ingo
authors: I
authors: Hertrich
authors: Susanne
authors: S
authors: Dietrich
authors: Hermann
authors: H
authors: Ackermann
keywords: audiovisual pathways; blindness; speech perception; speech timing; time-compressed speech
references: Proc Natl Acad Sci U S A. 1991 Mar 1;88(5):1621-5
references: 2000370
references: Eur J Neurosci. 2002 Jul;16(2):311-29
references: 12169112
references: PLoS One. 2012;7(5):e31603
references: 22666311
references: Cogn Psychol. 1982 Apr;14(2):247-79
references: 7083803
references: Neurology. 2005 Feb 22;64(4):700-6
references: 15728295
references: Nat Neurosci. 2012 Jun;15(6):905-12
references: 22561455
references: Nat Neurosci. 2010 Nov;13(11):1309-11
references: 20975752
references: AJNR Am J Neuroradiol. 2003 Nov-Dec;24(10):1967-74
references: 14625218
references: J Neurosci. 2012 Jun 27;32(26):9089-102
references: 22745508
references: Restor Neurol Neurosci. 2007;25(3-4):311-22
references: 17943008
references: J Cogn Neurosci. 2009 Feb;21(2):259-74
references: 18510440
references: BMC Neurosci. 2013 Jul 23;14:74
references: 23879896
references: J Neurosci. 2002 Nov 15;22(22):9941-4
references: 12427851
references: J Neurosci. 2007 Apr 11;27(15):4120-31
references: 17428990
references: Exp Brain Res. 2011 Sep;213(2-3):167-74
references: 21479656
references: Nat Neurosci. 2003 Jul;6(7):674-81
references: 12830158
references: Trends Cogn Sci. 2000 Apr;4(4):131-138
references: 10740277
references: Neuroreport. 2005 Apr 4;16(5):419-23
references: 15770144
references: Neurosci Biobehav Rev. 2012 Jan;36(1):341-9
references: 21782846
references: Soc Neurosci. 2008;3(3-4):193-8
references: 18979388
references: Nat Neurosci. 2003 Jul;6(7):657-8
references: 12830152
references: Neuroimage. 2006 May 1;30(4):1414-32
references: 16413796
references: Neuropsychologia. 2005;43(13):1901-10
references: 15869766
references: J Cogn Neurosci. 2008 May;20(5):762-78
references: 18201133
references: Brain Res. 1984 May 21;300(1):63-81
references: 6733468
references: Brain Res Cogn Brain Res. 2002 Jun;14(1):115-28
references: 12063135
references: Cortex. 2011 Feb;47(2):217-35
references: 20163794
references: PLoS One. 2012;7(3):e33136
references: 22438894
references: Nat Neurosci. 2012 Mar 18;15(4):511-7
references: 22426255
references: Psychophysiology. 2012 Mar;49(3):322-34
references: 22175821
references: J Neurosci. 2011 Mar 23;31(12):4607-12
references: 21430160
references: Neuropsychologia. 2009 Jan;47(2):546-55
references: 18983860
references: Front Psychol. 2012 May 31;3:170
references: 22666214
references: Brain Lang. 2013 Jan;124(1):9-21
references: 23332808
references: J Neurosci. 2009 Dec 9;29(49):15564-74
references: 20007480
references: J Neurophysiol. 2009 Oct;102(4):2358-74
references: 19675285
references: Trends Cogn Sci. 2000 Jun;4(6):223-233
references: 10827445
references: Phonetica. 2009;66(1-2):113-26
references: 19390234
references: Neuropsychologia. 2007 Mar 25;45(6):1342-54
references: 17067640
references: Curr Opin Neurol. 2011 Aug;24(4):357-63
references: 21677583
references: J Neurosci. 2007 Oct 3;27(40):10734-41
references: 17913907
references: Behav Brain Res. 2009 Jan 3;196(1):134-8
references: 18805443
references: Proc Natl Acad Sci U S A. 2012 Feb 21;109(8):E505-14
references: 22308358
references: Neuroreport. 2004 Jul 19;15(10):1687-90
references: 15232308
references: Cortex. 2009 Sep;45(8):982-90
references: 19361785
references: Proc Natl Acad Sci U S A. 2005 Jan 25;102(4):1181-6
references: 15647358
references: Neurosci Lett. 2004 Mar 11;357(3):199-202
references: 15003284
references: J Neurosci. 2008 Apr 9;28(15):3958-65
references: 18400895
references: Brain Lang. 2008 Nov;107(2):91-101
references: 18226833
references: J Neurosci. 2011 Jan 12;31(2):373-84
references: 21228149
references: Magn Reson Imaging. 2006 Feb;24(2):181-5
references: 16455407
references: Cereb Cortex. 2003 Sep;13(9):977-86
references: 12902397
references: Trends Cogn Sci. 2010 Sep;14(9):392-9
references: 20655802
references: Neuropsychologia. 2011 Jun;49(7):2037-44
references: 21458471
references: Brain. 1998 Mar;121 ( Pt 3):409-19
references: 9549517
references: Trends Cogn Sci. 2003 Jul;7(7):293-299
references: 12860187
references: Phys Life Rev. 2010 Sep;7(3):269-84
references: 20447880
references: J Cogn Neurosci. 2011 Jun;23(6):1358-67
references: 20617889
references: Brain Lang. 2012 Jun;121(3):273-88
references: 22498237
references: Exp Brain Res. 2008 Mar;186(1):67-77
references: 18008066
references: Early Dev Parent. 1997 Sep;6(3-4):179-192
references: 24634574
references: Neurocase. 2009;15(2):163-70
references: 19241219
references: Neuroimage. 2005 Jan 1;24(1):235-43
references: 15588615
references: Nat Neurosci. 2004 Nov;7(11):1266-70
references: 15467719
references: Proc Natl Acad Sci U S A. 2006 May 16;103(20):7865-70
references: 16682637
references: Neuron. 2007 Jun 21;54(6):1001-10
references: 17582338
references: Brain Res. 2009 Jan 28;1251:151-61
references: 18992728
references: Brain Lang. 2004 May;89(2):370-6
references: 15068920
references: J Neurosci. 2003 May 15;23(10):4005-11
references: 12764085
references: J Cogn Neurosci. 2011 Jan;23(1):221-37
references: 20044895
references: Neuroimage. 2008 Jun;41(2):623-35
references: 18413290
references: Eur J Neurosci. 2002 Sep;16(5):930-6
references: 12372029
references: J Exp Psychol Hum Percept Perform. 2011 Jun;37(3):699-708
references: 20854000
references: Neurosci Biobehav Rev. 2007;31(8):1169-80
references: 17597210
references: Neuroimage. 2010 Apr 15;50(3):1219-30
references: 20080191
references: Hear Res. 2011 Jan;271(1-2):147-58
references: 20116422
references: J Neurosci. 2003 Sep 10;23(23):8281-90
references: 12967990
references: Nat Rev Neurosci. 2002 Jun;3(6):443-52
references: 12042879
references: Nature. 2000 Dec 14;408(6814):788
references: 11130706
references: PLoS One. 2011;6(8):e24016
references: 21909378
references: Prog Brain Res. 2008;171:467-73
references: 18718342
references: Cereb Cortex. 2008 Jul;18(7):1560-74
references: 18180245
references: Neurosci Lett. 2003 May 8;341(3):185-8
references: 12697279
references: Int J Biomed Imaging. 2008;2008:789539
references: 18274667
references: Trends Neurosci. 2005 May;28(5):264-71
references: 15866201
references: Clin Neurophysiol. 2010 Aug;121(8):1343-50
references: 20378402
references: Neurosci Res. 1994 May;19(3):251-68
references: 8058203
references: Nat Rev Neurosci. 2007 May;8(5):393-402
references: 17431404
references: Exp Brain Res. 2012 May;218(3):477-85
references: 22367399
references: Neuropsychologia. 2007 Jun 11;45(10):2307-21
references: 17397882
references: Brain Lang. 2010 Jan;112(1):3-11
references: 19698980
references: PLoS One. 2009;4(3):e4638
references: 19259259
references: Neuropsychologia. 2007 Feb 1;45(3):598-607
references: 16530232
references: Hum Brain Mapp. 2010 Nov;31(11):1686-701
references: 20162595
references: Hear Res. 2011 Feb;272(1-2):125-34
references: 21094680
references: Neuroreport. 2008 Feb 12;19(3):271-5
references: 18303565