title: The cocktail-party problem revisited: early processing and selection of multi-talker speech.
abstract: How do we recognize what one person is saying when others are speaking at the same time? This review summarizes widespread research in psychoacoustics, auditory scene analysis, and attention, all dealing with early processing and selection of speech, which has been stimulated by this question. Important effects occurring at the peripheral and brainstem levels are mutual masking of sounds and "unmasking" resulting from binaural listening. Psychoacoustic models have been developed that can predict these effects accurately, albeit using computational approaches rather than approximations of neural processing. Grouping—the segregation and streaming of sounds—represents a subsequent processing stage that interacts closely with attention. Sounds can be easily grouped—and subsequently selected—using primitive features such as spatial location and fundamental frequency. More complex processing is required when lexical, syntactic, or semantic information is used. Whereas it is now clear that such processing can take place preattentively, there also is evidence that the processing depth depends on the task-relevancy of the sound. This is consistent with the presence of a feedback loop in attentional control, triggering enhancement of to-be-selected input. Despite recent progress, there are still many unresolved issues: there is a need for integrative models that are neurophysiologically plausible, for research into grouping based on other than spatial or voice-related cues, for studies explicitly addressing endogenous and exogenous attention, for an explanation of the remarkable sluggishness of attention focused on dynamically changing sounds, and for research elucidating the distinction between binaural speech perception and sound localization.
authors.affiliation: TNO Human Factors, POB 23, 3769 ZG, Soesterberg, The Netherlands, a.w.bronkhorst@vu.nl.
authors.forename: Adelbert W
authors.initials: AW
authors.lastname: Bronkhorst
mesh_terms: D001288:Attention / Q000502:physiology*; D003463:Cues; D006801:Humans; D010470:Perceptual Masking / Q000502:physiology; D011571:Psychoacoustics; D013017:Sound Localization / Q000502:physiology*; D013018:Sound Spectrography; D013060:Speech / Q000502:physiology; D013061:Speech Acoustics; D013067:Speech Perception / Q000502:physiology*
references.citation: J Acoust Soc Am. 2011 Sep;130(3):1475-87
references.pmid: 21895088
references.citation: J Acoust Soc Am. 2005 Sep;118(3 Pt 1):1614-25
references.pmid: 16240821
references.citation: Philos Trans R Soc Lond B Biol Sci. 2012 Apr 5;367(1591):919-31
references.pmid: 22371614
references.citation: J Acoust Soc Am. 2009 Jan;125(1):447-56
references.pmid: 19173430
references.citation: Conscious Cogn. 1997 Jun;6(2/3):182-203
references.pmid: 9245453
references.citation: Philos Trans R Soc Lond B Biol Sci. 2008 Mar 12;363(1493):1023-35
references.pmid: 17827103
references.citation: J Acoust Soc Am. 2000 Feb;107(2):1065-6
references.pmid: 10687719
references.citation: Trends Cogn Sci. 1997 Dec;1(9):327-33
references.pmid: 21223942
references.citation: J Acoust Soc Am. 1991 Dec;90(6):2985-91
references.pmid: 1787238
references.citation: Cognition. 2008 Dec;109(3):345-62
references.pmid: 19007926
references.citation: J Speech Lang Hear Res. 1997 Jun;40(3):686-93
references.pmid: 9210123
references.citation: J Acoust Soc Am. 1971 Aug;50(2):637-55
references.pmid: 4106390
references.citation: J Acoust Soc Am. 2004 Jul;116(1):502-6
references.pmid: 15296009
references.citation: J Acoust Soc Am. 2002 Dec;112(6):2985-95
references.pmid: 12509020
references.citation: J Acoust Soc Am. 2001 Jun;109(6):2896-909
references.pmid: 11425132
references.citation: Proc R Soc Med. 1957 Sep;50(9):689-97
references.pmid: 13484973
references.citation: J Cogn Neurosci. 1998 Sep;10(5):590-604
references.pmid: 9802992
references.citation: J Acoust Soc Am. 2000 Feb;107(2):970-7
references.pmid: 10687706
references.citation: Proc Natl Acad Sci U S A. 2008 Sep 2;105(35):13174-8
references.pmid: 18719099
references.citation: J Acoust Soc Am. 2003 Oct;114(4 Pt 1):2236-52
references.pmid: 14587621
references.citation: J Acoust Soc Am. 2011 Sep;130(3):1463-74
references.pmid: 21895087
references.citation: J Exp Psychol Gen. 2014 Feb;143(1):38-45
references.pmid: 23339333
references.citation: Proc Natl Acad Sci U S A. 2001 Oct 9;98(21):12301-6
references.pmid: 11572938
references.citation: J Acoust Soc Am. 1988 Jul;84(1):101-14
references.pmid: 3411038
references.citation: Psychophysiology. 1995 Jan;32(1):55-65
references.pmid: 7878170
references.citation: Brain Lang. 2008 Mar;104(3):244-53
references.pmid: 17624417
references.citation: J Acoust Soc Am. 2013 Sep;134(3):2160-70
references.pmid: 23967946
references.citation: Trends Cogn Sci. 2008 May;12(5):182-6
references.pmid: 18396091
references.citation: J Acoust Soc Am. 1975 Jul;58(1):214-22
references.pmid: 1150969
references.citation: Neurosci Lett. 2001 Apr 6;301(3):179-82
references.pmid: 11257427
references.citation: J Acoust Soc Am. 2006 Jun;119(6):4027-40
references.pmid: 16838545
references.citation: Neuron. 2013 Mar 6;77(5):980-91
references.pmid: 23473326
references.citation: Eur J Neurosci. 2012 May;35(9):1497-503
references.pmid: 22462504
references.citation: IEEE Trans Audio Speech Lang Process. 2009 Jul 1;17(5):1009-1024
references.pmid: 20084186
references.citation: Percept Psychophys. 2007 Jan;69(1):79-91
references.pmid: 17515218
references.citation: Prog Neurobiol. 2006 May;79(1):49-71
references.pmid: 16814448
references.citation: J Acoust Soc Am. 2002 Nov;112(5 Pt 1):2086-98
references.pmid: 12430820
references.citation: Philos Trans R Soc Lond B Biol Sci. 2008 Mar 12;363(1493):965-78
references.pmid: 17827108
references.citation: J Exp Psychol Hum Percept Perform. 2011 Aug;37(4):1140-7
references.pmid: 21553997
references.citation: Curr Biol. 2009 Dec 1;19(22):R1024-7
references.pmid: 19948136
references.citation: J Acoust Soc Am. 2001 Nov;110(5 Pt 1):2527-38
references.pmid: 11757942
references.citation: J Acoust Soc Am. 1992 Mar;91(3):1648-61
references.pmid: 1564201
references.citation: Psychophysiology. 2011 Jan;48(1):4-22
references.pmid: 20880261
references.citation: Psychophysiology. 1987 Jul;24(4):375-425
references.pmid: 3615753
references.citation: Percept Psychophys. 1998 Oct;60(7):1228-42
references.pmid: 9821784
references.citation: J Acoust Soc Am. 2001 Mar;109(3):1101-9
references.pmid: 11303924
references.citation: J Exp Psychol Gen. 1995 Sep;124(3):243-62
references.pmid: 7673862
references.citation: Vision Res. 2005 Jan;45(2):205-31
references.pmid: 15581921
references.citation: J Acoust Soc Am. 2004 Aug;116(2):1057-65
references.pmid: 15376672
references.citation: Hear Res. 2013 Nov;305:57-73
references.pmid: 23792076
references.citation: J Acoust Soc Am. 1988 Apr;83(4):1508-16
references.pmid: 3372866
references.citation: Psychol Rev. 2010 Jan;117(1):175-96
references.pmid: 20063967
references.citation: J Acoust Soc Am. 2010 Apr;127(4):2479-97
references.pmid: 20370031
references.citation: J Acoust Soc Am. 1994 Feb;95(2):1053-64
references.pmid: 8132899
references.citation: Brain Res Cogn Brain Res. 1999 Oct 25;8(3):213-27
references.pmid: 10556600
references.citation: J Acoust Soc Am. 2013 Oct;134(4):3039-56
references.pmid: 24116439
references.citation: J Acoust Soc Am. 2010 Dec;128(6):3678-90
references.pmid: 21218900
references.citation: J Acoust Soc Am. 2006 Mar;119(3):1562-73
references.pmid: 16583901
references.citation: J Acoust Soc Am. 1980 Jan;67(1):318-26
references.pmid: 7354199
references.citation: J Acoust Soc Am. 2003 Oct;114(4 Pt 1):2178-89
references.pmid: 14587615
references.citation: J Acoust Soc Am. 2010 Jun;127(6):EL258-64
references.pmid: 20550229
references.citation: Neurosci Lett. 2011 Feb 1;489(1):53-6
references.pmid: 21130840
references.citation: J Exp Psychol Learn Mem Cogn. 1995 Jan;21(1):255-60
references.pmid: 7876773
references.citation: J Exp Psychol Learn Mem Cogn. 2012 Nov;38(6):1542-57
references.pmid: 22612161
references.citation: J Acoust Soc Am. 2005 Dec;118(6):3804-15
references.pmid: 16419825
references.citation: Science. 1981 May 22;212(4497):947-9
references.pmid: 7233191
references.citation: Behav Res Methods. 2010 Aug;42(3):665-70
references.pmid: 20805588
references.citation: Proc Natl Acad Sci U S A. 2011 Mar 8;108(10):4182-7
references.pmid: 21368107
references.citation: J Acoust Soc Am. 1995 Aug;98(2 Pt 1):785-97
references.pmid: 7642817
references.citation: J Acoust Soc Am. 1977 May;61(5):1337-51
references.pmid: 881487
references.citation: J Acoust Soc Am. 2002 Jun;111(6):2874-86
references.pmid: 12083221
references.citation: J Acoust Soc Am. 2005 Apr;117(4 Pt 1):2181-92
references.pmid: 15898659
references.citation: Cereb Cortex. 2011 Mar;21(3):698-707
references.pmid: 20685854
references.citation: J Acoust Soc Am. 2001 May;109(5 Pt 1):2112-22
references.pmid: 11386563
references.citation: Percept Psychophys. 1992 Jun;51(6):599-606
references.pmid: 1620571
references.citation: J Acoust Soc Am. 1990 Oct;88(4):1725-36
references.pmid: 2262629
references.citation: Annu Rev Neurosci. 2008;31:511-34
references.pmid: 18558865
references.citation: Proc Natl Acad Sci U S A. 1993 Sep 15;90(18):8722-6
references.pmid: 8378354
references.citation: Psychon Bull Rev. 2000 Sep;7(3):403-23
references.pmid: 11082850
references.citation: J Acoust Soc Am. 1973 Dec;54(6):1458-70
references.pmid: 4780800
references.citation: Philos Trans R Soc Lond B Biol Sci. 2008 Mar 12;363(1493):1011-21
references.pmid: 17827106
references.citation: J Acoust Soc Am. 2003 Nov;114(5):2913-22
references.pmid: 14650025
references.citation: Annu Rev Psychol. 1991;42:135-59
references.pmid: 2018391
references.citation: Brain Res. 2013 Jan 15;1490:153-60
references.pmid: 23123705
references.citation: Atten Percept Psychophys. 2009 Jan;71(1):164-73
references.pmid: 19304606
references.citation: J Acoust Soc Am. 2006 Dec;120(6):3988-97
references.pmid: 17225425
references.citation: Brain Res. 2008 Jul 18;1220:164-70
references.pmid: 18655852
references.citation: J Acoust Soc Am. 2010 Nov;128(5):2998-10
references.pmid: 21110595
references.citation: Wiley Interdiscip Rev Cogn Sci. 2010 Jan;1(1):69-78
references.pmid: 26272840
references.citation: J Acoust Soc Am. 1999 Dec;106(6):3578-88
references.pmid: 10615698
references.citation: J Acoust Soc Am. 2007 Sep;122(3):1765
references.pmid: 17927436
references.citation: Psychol Rev. 1963 Jan;70:80-90
references.pmid: 14027390
references.citation: J Exp Psychol Hum Percept Perform. 2004 Feb;30(1):180-93
references.pmid: 14769076
references.citation: Psychol Res. 2014;78(3):321-38
references.pmid: 24363092
references.citation: Psychol Rev. 1976 Mar;83(2):114-40
references.pmid: 769016
references.citation: Percept Psychophys. 1987 Sep;42(3):215-23
references.pmid: 3671047
references.citation: Psychol Sci. 2013 Oct;24(10):1995-2004
references.pmid: 23985575
references.citation: Percept Psychophys. 1997 Jan;59(1):1-22
references.pmid: 9038403
references.citation: J Acoust Soc Am. 1993 Jan;93(1):499-509
references.pmid: 8423265
references.citation: J Acoust Soc Am. 2012 Jan;131(1):218-31
references.pmid: 22280586
references.citation: J Exp Psychol Hum Percept Perform. 1999 Jun;25(3):617-29
references.pmid: 10385981
references.citation: Acta Psychol (Amst). 1978 Jul;42(4):313-29
references.pmid: 685709
references.citation: J Acoust Soc Am. 2008 Jun;123(6):4514-23
references.pmid: 18537400
references.citation: J Acoust Soc Am. 2012 Oct;132(4):2545-56
references.pmid: 23039448
references.citation: Audiology. 1979 Jan-Feb;18(1):43-52
references.pmid: 760724
references.citation: Cognition. 2008 Jan;106(1):408-32
references.pmid: 17445791
references.citation: IEEE Trans Neural Netw. 2004 Sep;15(5):1135-50
references.pmid: 18238087
references.citation: Proc Natl Acad Sci U S A. 2006 Sep 26;103(39):14608-13
references.pmid: 16983092
references.citation: J Speech Lang Hear Res. 1999 Oct;42(5):1148-56
references.pmid: 10515512
references.citation: J Acoust Soc Am. 2013 Jul;134(1):436-46
references.pmid: 23862819
references.citation: Psychol Bull. 1988 Sep;104(2):163-91
references.pmid: 3054993