title: Analysis and compensation of the effects of analog VLSI arithmetic on the LMS algorithm.
abstract: Analog very large scale integration implementations of neural networks can compute using a fraction of the size and power required by their digital counterparts. However, intrinsic limitations of analog hardware, such as device mismatch, charge leakage, and noise, reduce the accuracy of analog arithmetic circuits, degrading the performance of large-scale adaptive systems. In this paper, we present a detailed mathematical analysis that relates different parameters of the hardware limitations to specific effects on the convergence properties of linear perceptrons trained with the least-mean-square (LMS) algorithm. Using this analysis, we derive design guidelines and introduce simple on-chip calibration techniques to improve the accuracy of analog neural networks with a small cost in die area and power dissipation. We validate our analysis by evaluating the performance of a mixed-signal complementary metal-oxide-semiconductor implementation of a 32-input perceptron trained with LMS.
authors.affiliation: Department of Electrical Engineering, Universidad de Concepción, Concepción, Chile. gcarvaja@udec.cl
authors.forename: Gonzalo
authors.initials: G
authors.lastname: Carvajal
authors.forename: Miguel
authors.initials: M
authors.lastname: Figueroa
authors.forename: Daniel
authors.initials: D
authors.lastname: Sbarbaro
authors.forename: Waldo
authors.initials: W
authors.lastname: Valenzuela
mesh_terms: D000465:Algorithms; D001185:Artificial Intelligence; D003202:Computers, Analog; D016571:Neural Networks, Computer