title: How inhibitory oscillations can train neural networks and punish competitors.
abstract: We present a new learning algorithm that leverages oscillations in the strength of neural inhibition to train neural networks. Raising inhibition can be used to identify weak parts of target memories, which are then strengthened. Conversely, lowering inhibition can be used to identify competitors, which are then weakened. To update weights, we apply the Contrastive Hebbian Learning equation to successive time steps of the network. The sign of the weight change equation varies as a function of the phase of the inhibitory oscillation. We show that the learning algorithm can memorize large numbers of correlated input patterns without collapsing and that it shows good generalization to test patterns that do not exactly match studied patterns.
authors.affiliation: Department of Psychology, Princeton University, NJ 08544, USA. knorman@princeton.edu
authors.forename: Kenneth A
authors.initials: KA
authors.lastname: Norman
authors.forename: Ehren
authors.initials: E
authors.lastname: Newman
authors.forename: Greg
authors.initials: G
authors.lastname: Detre
authors.forename: Sean
authors.initials: S
authors.lastname: Polyn
mesh_terms: D000465:Algorithms; D000818:Animals; D003198:Computer Simulation; D006801:Humans; D007858:Learning / Q000502:physiology*; D008959:Models, Neurological; D009415:Nerve Net / Q000502:physiology*; D009433:Neural Inhibition / Q000502:physiology*; D016571:Neural Networks, Computer; D010507:Periodicity; D011678:Punishment; D013997:Time Factors