Many-body approach to the dynamics of batch learning
Using the cavity method and diagrammatic methods, we model the dynamics of batch learning of restricted sets of examples, widely applicable to general learning cost functions, and fully taking into account the temporal correlations introduced by the recycling of the examples. The approach is illustrated using the Adaline rule learning teacher-generated or random examples.
Wong
KY
Department of Physics, Hong Kong University of Science and Technology, Clear Water Bay, Kowloon, Hong Kong.
Li
S
Tong
YW