A fundamental limitation of the conjunctive codes learned in PDP models of cognition: comment on Botvinick and Plaut (2006).
A central claim shared by most recent models of short-term memory (STM) is that item knowledge is coded independently from order in long-term memory (LTM; e.g., the letter A is coded by the same representational unit whether it occurs at the start or end of a sequence). Serial order is computed by dynamically binding these item codes to a separate representation of order. By contrast, Botvinick and Plaut developed a parallel distributed processing (PDP) model of STM that codes for item-order information conjunctively, such that the same letter in different positions is coded differently in LTM. Their model supports a wide range of memory phenomena, and critically, STM is better for lists that include high, as opposed to low, sequential dependencies (e.g., bigram effects). Models with context-independent item representations do not currently account for sequential effects. However, we show that their PDP model is too sensitive to these effects. A modified version of the model does better but still fails in important respects. The successes and failures can be attributed to a fundamental constraint associated with context-dependent representations. We question the viability of conjunctive coding schemes to support STM and take these findings as problematic for the PDP approach to cognition more generally.
Department of Experimental, University of Bristol, Clifton, Bristol, England. j.bowers@bris.ac.uk
Jeffrey S
JS
Bowers
Markus F
MF
Damian
Colin J
CJ
Davis
D001245:Association Learning; D001288:Attention; D003071:Cognition; D005793:Generalization, Psychological; D006801:Humans; D008570:Memory, Short-Term; D008960:Models, Psychological; D016571:Neural Networks, Computer; D012153:Retention, Psychology; D012691:Serial Learning; D013561:Symbolism