title: When and Where to Transfer for Bayes Net Parameter Learning.
abstract: Learning Bayesian networks from scarce data is a major challenge in real-world applications where data are hard to acquire. Transfer learning techniques attempt to address this by leveraging data from different but related problems. For example, it may be possible to exploit medical diagnosis data from a different country. A challenge with this approach is heterogeneous relatedness to the target, both within and across source networks. In this paper we introduce the Bayesian network parameter transfer learning (BNPTL) algorithm to reason about both network and fragment (sub-graph) relatedness. BNPTL addresses (i) how to find the most relevant source network and network fragments to transfer, and (ii) how to fuse source and target parameters in a robust way. In addition to improving target task performance, explicit reasoning allows us to diagnose network and fragment relatedness across BNs, even if latent variables are present, or if their state space is heterogeneous. This is important in some applications where relatedness itself is an output of interest. Experimental results demonstrate the superiority of BNPTL at various scarcities and source relevance levels compared to single task learning and other state-of-the-art parameter transfer methods. Moreover, we demonstrate successful application to real-world medical case studies.
authors.affiliation: Risk and Information Management (RIM) Research Group, Queen Mary University of London; Science and Technology on Information Systems Engineering Laboratory, National University of Defense Technology.
authors.forename: Yun
authors.initials: Y
authors.lastname: Zhou
authors.affiliation: Risk and Information Management (RIM) Research Group, Queen Mary University of London.
authors.forename: Timothy M
authors.initials: TM
authors.lastname: Hospedales
authors.affiliation: Risk and Information Management (RIM) Research Group, Queen Mary University of London.
authors.forename: Norman
authors.initials: N
authors.lastname: Fenton
keywords: Bayesian model averaging; Bayesian model comparison; Bayesian networks parameter learning; Transfer learning