A fundamental limitation of the conjunctive codes learned in PDP models of cognition: comment on Botvinick and Plaut (2006).
A central claim shared by most recent models of short-term memory (STM) is that item knowledge is coded independently from order in long-term memory (LTM; e.g., the letter A is coded by the same representational unit whether it occurs at the start or end of a sequence). Serial order is computed by dynamically binding these item codes to a separate representation of order. By contrast, Botvinick and Plaut developed a parallel distributed processing (PDP) model of STM that codes for item-order information conjunctively, such that the same letter in different positions is coded differently in LTM. Their model supports a wide range of memory phenomena, and critically, STM is better for lists that include high, as opposed to low, sequential dependencies (e.g., bigram effects). Models with context-independent item representations do not currently account for sequential effects. However, we show that their PDP model is too sensitive to these effects. A modified version of the model does better but still fails in important respects. The successes and failures can be attributed to a fundamental constraint associated with context-dependent representations. We question the viability of conjunctive coding schemes to support STM and take these findings as problematic for the PDP approach to cognition more generally.
Bowers
Jeffrey S
JS
Department of Experimental, University of Bristol, Clifton, Bristol, England. j.bowers@bris.ac.uk
Damian
Markus F
MF
Davis
Colin J
CJ
D001245:Association Learning; D001288:Attention; D003071:Cognition; D005793:Generalization, Psychological; D006801:Humans; D008570:Memory, Short-Term; D008960:Models, Psychological; D016571:Neural Networks, Computer; D012153:Retention, Psychology; D012691:Serial Learning; D013561:Symbolism