title: Short-term memory in orthogonal neural networks.
abstract: We study the ability of linear recurrent networks obeying discrete time dynamics to store long temporal sequences that are retrievable from the instantaneous state of the network. We calculate this temporal memory capacity for both distributed shift register and random orthogonal connectivity matrices. We show that the memory capacity of these networks scales with system size.
authors.affiliation: Harvard University, Cambridge, Massachusetts 02138, USA.
authors.forename: Olivia L
authors.initials: OL
authors.lastname: White
authors.forename: Daniel D
authors.initials: DD
authors.lastname: Lee
authors.forename: Haim
authors.initials: H
authors.lastname: Sompolinsky
mesh_terms: D008570:Memory, Short-Term; D008959:Models, Neurological; D016571:Neural Networks, Computer; D009474:Neurons / Q000502:physiology