When ears drive hands: the influence of contact sound on reaching to grasp.
BACKGROUND
Most research on the roles of auditory information and its interaction with vision has focused on perceptual performance. Little is known on the effects of sound cues on visually-guided hand movements.


RESULTS
We recorded the sound produced by the fingers upon contact as participants grasped stimulus objects which were covered with different materials. Then, in a further session the pre-recorded contact sounds were delivered to participants via headphones before or following the initiation of reach-to-grasp movements towards the stimulus objects. Reach-to-grasp movement kinematics were measured under the following conditions: (i) congruent, in which the presented contact sound and the contact sound elicited by the to-be-grasped stimulus corresponded; (ii) incongruent, in which the presented contact sound was different to that generated by the stimulus upon contact; (iii) control, in which a synthetic sound, not associated with a real event, was presented. Facilitation effects were found for congruent trials; interference effects were found for incongruent trials. In a second experiment, the upper and the lower parts of the stimulus were covered with different materials. The presented sound was always congruent with the material covering either the upper or the lower half of the stimulus. Participants consistently placed their fingers on the half of the stimulus that corresponded to the presented contact sound.


CONCLUSIONS
Altogether these findings offer a substantial contribution to the current debate about the type of object representations elicited by auditory stimuli and on the multisensory nature of the sensorimotor transformations underlying action.
Castiello
Umberto
U
Dipartimento di Psicologia Generale, Università di Padova, Padova, Italy. umberto.castiello@unipd.it
Giordano
Bruno L
BL
Begliomini
Chiara
C
Ansuini
Caterina
C
Grassi
Massimo
M
D000328:Adult; D001696:Biomechanical Phenomena; D004423:Ear; D005260:Female; D005385:Fingers / Q000502:physiology; D006225:Hand / Q000502:physiology*; D018737:Hand Strength / Q000502:physiology*; D006801:Humans; D008297:Male; D010775:Photic Stimulation; D013016:Sound
PLoS One. 2008 Mar 19;3(3):e1795
18350137
Nat Neurosci. 2000 Mar;3(3):277-83
10700261
Trends Cogn Sci. 2000 Nov 1;4(11):423-431
11058820
J Mot Behav. 1984 Sep;16(3):235-54
15151851
J Exp Psychol Hum Percept Perform. 2000 Feb;26(1):279-94
10696618
Nature. 1999 Feb 4;397(6718):428-30
9989407
Science. 1995 Sep 29;269(5232):1880-2
7569931
Percept Psychophys. 2008 Jan;70(1):13-29
18306957
Exp Brain Res. 2006 Sep;173(4):629-36
16525801
Exp Brain Res. 2006 Apr;170(4):532-42
16307260
Exp Brain Res. 2008 Apr;186(4):619-27
18214451
Chem Senses. 2006 Sep;31(7):665-71
16793857
Behav Brain Sci. 1997 Jun;20(2):279-303; discussion 303-49
10096999
Behav Brain Sci. 2004 Feb;27(1):3-24; discussion 24-78
15481943
Nat Rev Neurosci. 2001 Sep;2(9):661-70
11533734
Neuroreport. 1998 Mar 30;9(5):887-91
9579685
J Acoust Soc Am. 2004 Mar;115(3):1252-65
15058346
J Acoust Soc Am. 2006 Feb;119(2):1171-81
16521778
Exp Brain Res. 2002 Sep;146(2):161-71
12195518
Neuroimage. 2008 Jul 1;41(3):1011-20
18440831
Percept Psychophys. 2005 Feb;67(2):274-84
15971691
Psychon Bull Rev. 2003 Dec;10(4):924-31
15000540
Exp Brain Res. 2003 Dec;153(4):628-36
12937876
J Acoust Soc Am. 1991 Dec;90(6):3036-49
1787243
Psychol Rev. 1988 Jul;95(3):340-70
3406245
J Exp Psychol Hum Percept Perform. 1998 Dec;24(6):1571-81
9861711
Q J Exp Psychol A. 1983 May;35(Pt 2):251-78
6571310
Chem Senses. 2008 Jun;33(5):433-40
18344564
Neuropsychologia. 1971 Mar;9(1):97-113
5146491
Curr Biol. 2006 Sep 19;16(18):1824-9
16979560
J Acoust Soc Am. 1987 Apr;81(4):1100-9
3571727
Exp Brain Res. 2003 Sep;152(2):156-65
12879179
Nat Rev Neurosci. 2009 May;10(5):345-59
19352402
Nat Neurosci. 2000 Nov;3 Suppl:1212-7
11127840
Exp Brain Res. 1991;86(1):199-208
1756790
Science. 2002 Aug 2;297(5582):846-8
12161656
J Neurosci. 2007 Apr 4;27(14):3894-903
17409254