title: Probing the time course of head-motion cues integration during auditory scene analysis.
abstract: The perceptual organization of auditory scenes is a hard but important problem to solve for human listeners. It is thus likely that cues from several modalities are pooled for auditory scene analysis, including sensory-motor cues related to the active exploration of the scene. We previously reported a strong effect of head motion on auditory streaming. Streaming refers to an experimental paradigm where listeners hear sequences of pure tones, and rate their perception of one or more subjective sources called streams. To disentangle the effects of head motion (changes in acoustic cues at the ear, subjective location cues, and motor cues), we used a robotic telepresence system, Telehead. We found that head motion induced perceptual reorganization even when the acoustic scene had not changed. Here we reanalyzed the same data to probe the time course of sensory-motor integration. We show that motor cues had a different time course compared to acoustic or subjective location cues: motor cues impacted perceptual organization earlier and for a shorter time than other cues, with successive positive and negative contributions to streaming. An additional experiment controlled for the effects of volitional anticipatory components, and found that arm or leg movements did not have any impact on scene analysis. These data provide a first investigation of the time course of the complex integration of sensory-motor cues in an auditory scene analysis task, and they suggest a loose temporal coupling between the different mechanisms involved.
authors.affiliation: NTT Communication Science Laboratories, NTT Corporation Atsugi, Japan ; Department of Child Development, United Graduate School of Child Development, Osaka University, Kanazawa University, Hamamatsu University School of Medicine, Chiba University, and University of Fukui Suita, Japan.
authors.forename: Hirohito M
authors.initials: HM
authors.lastname: Kondo
authors.affiliation: NTT Communication Science Laboratories, NTT Corporation Atsugi, Japan.
authors.forename: Iwaki
authors.initials: I
authors.lastname: Toshima
authors.affiliation: Laboratoire des Systèmes Perceptifs, CNRS UMR 8248 Paris, France ; Département d'études cognitives, École normale supérieure Paris, France.
authors.forename: Daniel
authors.initials: D
authors.lastname: Pressnitzer
authors.affiliation: NTT Communication Science Laboratories, NTT Corporation Atsugi, Japan ; Department of Information Processing, Interdisciplinary Graduate School of Science and Engineering, Tokyo Institute of Technology Yokohama, Japan.
authors.forename: Makio
authors.initials: M
authors.lastname: Kashino
keywords: auditory streaming; bistable perception; build-up; cocktail party problem; crossmodal; head movement; hearing; virtual reality