Audiovisual semantic congruency during encoding enhances memory performance.
Studies of memory and learning have usually focused on a single sensory modality, although human perception is multisensory in nature. In the present study, we investigated the effects of audiovisual encoding on later unisensory recognition memory performance. The participants were to memorize auditory or visual stimuli (sounds, pictures, spoken words, or written words), each of which co-occurred with either a semantically congruent stimulus, incongruent stimulus, or a neutral (non-semantic noise) stimulus in the other modality during encoding. Subsequent memory performance was overall better when the stimulus to be memorized was initially accompanied by a semantically congruent stimulus in the other modality than when it was accompanied by a neutral stimulus. These results suggest that semantically congruent multisensory experiences enhance encoding of both nonverbal and verbal materials, resulting in an improvement in their later recognition memory.
Division of Cognitive Psychology and Neuropsychology, Institute of Behavioural Sciences, University of Helsinki, <location>Finland</location>
Jenni
J
Heikkilä
Division of Cognitive Psychology and Neuropsychology, Institute of Behavioural Sciences, University of Helsinki, <location>Finland</location> Helsinki Collegium for Advanced Studies, University of Helsinki, <location>Finland</location>
Kimmo
K
Alho
Division of Cognitive Psychology and Neuropsychology, Institute of Behavioural Sciences, University of Helsinki, <location>Finland</location>
Heidi
H
Hyvönen
Division of Cognitive Psychology and Neuropsychology, Institute of Behavioural Sciences, University of Helsinki, <location>Finland</location>
Kaisa
K
Tiippana
D000161:Acoustic Stimulation / Q000379:methods; D001307:Auditory Perception / Q000502:physiology*; D004192:Discrimination, Psychological / Q000502:physiology*; D005260:Female; D006801:Humans; D008297:Male; D008568:Memory / Q000502:physiology*; D010465:Perception; D010775:Photic Stimulation / Q000379:methods; D021641:Recognition, Psychology; D012660:Semantics; D014796:Visual Perception / Q000502:physiology*; D055815:Young Adult
audiovisual; multisensory; recognition memory; semantic congruency