Sequential associative memory with nonuniformity of the layer sizes.
Sequence retrieval has a fundamental importance in information processing by the brain, and has extensively been studied in neural network models. Most of the previous sequential associative memory embedded sequences of memory patterns have nearly equal sizes. It was recently shown that local cortical networks display many diverse yet repeatable precise temporal sequences of neuronal activities, termed "neuronal avalanches." Interestingly, these avalanches displayed size and lifetime distributions that obey power laws. Inspired by these experimental findings, here we consider an associative memory model of binary neurons that stores sequences of memory patterns with highly variable sizes. Our analysis includes the case where the statistics of these size variations obey the above-mentioned power laws. We study the retrieval dynamics of such memory systems by analytically deriving the equations that govern the time evolution of macroscopic order parameters. We calculate the critical sequence length beyond which the network cannot retrieve memory sequences correctly. As an application of the analysis, we show how the present variability in sequential memory patterns degrades the power-law lifetime distribution of retrieved neural activities.
Teramae
Jun-Nosuke
JN
Laboratory for Neural Circuit Theory, RIKEN Brain Science Institute, Hirosawa 2-1, Wako, Saitama 351-0198, Japan. teramae@brain.riken.jp
Fukai
Tomoki
T
D000818:Animals; D001703:Biophysics / Q000379:methods*; D001921:Brain / Q000502:physiology*; D006801:Humans; D008568:Memory; D008954:Models, Biological; D008959:Models, Neurological; D015233:Models, Statistical; D009415:Nerve Net; D009474:Neurons / Q000378:metabolism* / Q000502:physiology*; D013269:Stochastic Processes; D009435:Synaptic Transmission / Q000502:physiology; D013997:Time Factors