Title:Partial Ordering of Inhomogeneous Markov Chains with Applications to Markov Chain Monte Carlo Methods

Abstract:In this paper we study the asymptotic variance of sample path averages for inhomogeneous Markov chains that evolve alternatingly according to two different $\pi$-reversible Markov transition kernels. More specifically, we define a partial ordering over the pairs of $\pi$-reversible Markov kernels, which allows us to compare directly the asymptotic variances for the inhomogeneous Markov chains associated with each pair. As an important application we use this result for comparing different data-augmentation-type Metropolis-Hastings algorithms. In particular, we compare some pseudo-marginal algorithms (in the terminology of [1]) and propose a novel exact algorithm, referred to as the random refreshment algorithm, which is more efficient, in terms of asymptotic variance, than the Grouped Independence Metropolis Hastings (GIMH) algorithm and has a computational complexity that does not exceed that of the Monte Carlo Within Metropolis (MCWM) algorithm. Finally, we provide a theoretical justification of the Carlin and Chib algorithm [3] used in model selection.