Data augmentation for models based on rejection sampling.
We present a data augmentation scheme to perform Markov chain Monte Carlo inference for models where data generation involves a rejection sampling algorithm. Our idea is a simple scheme to instantiate the rejected proposals preceding each data point. The resulting joint probability over observed and rejected variables can be much simpler than the marginal distribution over the observed variables, which often involves intractable integrals. We consider three problems: modelling flow-cytometry measurements subject to truncation; the Bayesian analysis of the matrix Langevin distribution on the Stiefel manifold; and Bayesian inference for a nonparametric Gaussian process density model. The latter two are instances of doubly-intractable Markov chain Monte Carlo problems, where evaluating the likelihood is intractable. Our experiments demonstrate superior performance over state-of-the-art sampling algorithms for such problems.
Department of Statistics, Purdue University, West Lafayette, Indiana 47907, U.S.A.
Vinayak
V
Rao
Department of Statistics and Data Science, The University of Texas, Austin, Texas 78712, U.S.A. , lizhen.lin@austin.utexas.edu.
Lizhen
L
Lin
Department of Statistical Science, Duke University, Durham, North Carolina 27708, U.S.A. , dunson@duke.edu.
David B
DB
Dunson
Bayesian inference; Density estimation; Gaussian process; Intractable likelihood; Markov chain Monte Carlo; Matrix Langevin distribution; Rejection sampling; Truncation