title: Unified framework for information integration based on information geometry.
abstract: Assessment of causal influences is a ubiquitous and important subject across diverse research fields. Drawn from consciousness studies, integrated information is a measure that defines integration as the degree of causal influences among elements. Whereas pairwise causal influences between elements can be quantified with existing methods, quantifying multiple influences among many elements poses two major mathematical difficulties. First, overestimation occurs due to interdependence among influences if each influence is separately quantified in a part-based manner and then simply summed over. Second, it is difficult to isolate causal influences while avoiding noncausal confounding influences. To resolve these difficulties, we propose a theoretical framework based on information geometry for the quantification of multiple causal influences with a holistic approach. We derive a measure of integrated information, which is geometrically interpreted as the divergence between the actual probability distribution of a system and an approximated probability distribution where causal influences among elements are statistically disconnected. This framework provides intuitive geometric interpretations harmonizing various information theoretic measures in a unified manner, including mutual information, transfer entropy, stochastic interaction, and integrated information, each of which is characterized by how causal influences are disconnected. In addition to the mathematical assessment of consciousness, our framework should help to analyze causal relationships in complex systems in a complete and hierarchical manner.
authors.affiliation: RIKEN Brain Science Institute, Wako, Saitama 351-0198, Japan; oizumi@brain.riken.jp.|School of Psychological Sciences, Faculty of Biomedical and Psychological Sciences, Monash University, Melbourne, VIC 3800, Australia.
authors.forename: Masafumi
authors.initials: M
authors.lastname: Oizumi
authors.affiliation: School of Psychological Sciences, Faculty of Biomedical and Psychological Sciences, Monash University, Melbourne, VIC 3800, Australia.|Monash Institute of Cognitive and Clinical Neuroscience, Monash University, Melbourne, VIC 3800, Australia.|Advanced Telecommunications Research Institute International, Hikaridai, Keihanna Science City, Kyoto 619-0288, Japan.
authors.forename: Naotsugu
authors.identifier: 0000-0003-4216-8701
authors.initials: N
authors.lastname: Tsuchiya
authors.affiliation: RIKEN Brain Science Institute, Wako, Saitama 351-0198, Japan.
authors.forename: Shun-Ichi
authors.initials: SI
authors.lastname: Amari
keywords: consciousness; information geometry; integrated information; mutual information; transfer entropy