title: First-order versus second-order single-layer recurrent neural networks.
abstract: We examine the representational capabilities of first-order and second-order single-layer recurrent neural networks (SLRNN's) with hard-limiting neurons. We show that a second-order SLRNN is strictly more powerful than a first-order SLRNN. However, if the first-order SLRNN is augmented with output layers of feedforward neurons, it can implement any finite-state recognizer, but only if state-splitting is employed. When a state is split, it is divided into two equivalent states. The judicious use of state-splitting allows for efficient implementation of finite-state recognizers using augmented first-order SLRNN's.
authors.affiliation: Princeton Univ., NJ.
authors.forename: M W
authors.initials: MW
authors.lastname: Goudreau
authors.forename: C L
authors.initials: CL
authors.lastname: Giles
authors.forename: S T
authors.initials: ST
authors.lastname: Chakradhar
authors.forename: D
authors.initials: D
authors.lastname: Chen