title: Information geometry of mean-field approximation.
abstract: I present a general theory of mean-field approximation based on information geometry and applicable not only to Boltzmann machines but also to wider classes of statistical models. Using perturbation expansion of the Kullback divergence (or Plefka expansion in statistical physics), a formulation of mean-field approximation of general orders is derived. It includes in a natural way the "naive" mean-field approximation and is consistent with the Thouless-Anderson-Palmer (TAP) approach and the linear response theorem in statistical physics.
authors.affiliation: Department of Electronics and Information Engineering, Tokyo Metropolitan University, Tokyo 192-0397, Japan.
authors.forename: T
authors.initials: T
authors.lastname: Tanaka
mesh_terms: D001185:Artificial Intelligence; D007257:Information Theory; D016014:Linear Models; D015233:Models, Statistical; D055585:Physical Phenomena; D010825:Physics