The Library
Accelerating pseudo-marginal MCMC using Gaussian processes
Tools
Tools
Tools
Drovandi, Christopher C., Moores, Matthew T. and Boys, Richard J. (2018) Accelerating pseudo-marginal MCMC using Gaussian processes. Computational Statistics & Data Analysis, 118 . doi:10.1016/j.csda.2017.09.002
|
PDF
WRAP-accelerating-pseudo-marginal-MCMC-Gaussian-Moores-2017.pdf - Accepted Version - Requires a PDF viewer. Available under License Creative Commons Attribution Non-commercial No Derivatives 4.0. Download (24Mb) | Preview |
Official URL: http://dx.doi.org/10.1016/j.csda.2017.09.002
Abstract
The grouped independence Metropolis–Hastings (GIMH) and Markov chain within Metropolis (MCWM) algorithms are pseudo-marginal methods used to perform Bayesian inference in latent variable models. These methods replace intractable likelihood calculations with unbiased estimates within Markov chain Monte Carlo algorithms. The GIMH method has the posterior of interest as its limiting distribution, but suffers from poor mixing if it is too computationally intensive to obtain high-precision likelihood estimates. The MCWM algorithm has better mixing properties, but tends to give conservative approximations of the posterior and is still expensive. A new method is developed to accelerate the GIMH method by using a Gaussian process (GP) approximation to the log-likelihood and train this GP using a short pilot run of the MCWM algorithm. This new method called GP-GIMH is illustrated on simulated data from a stochastic volatility and a gene network model. The new approach produces reasonable posterior approximations in these examples with at least an order of magnitude improvement in computing time. Code to implement the method for the gene network example can be found at http://www.runmycode.org/companion/view/2663.
| Item Type: | Journal Article | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Subjects: | Q Science > QA Mathematics | |||||||||
| Divisions: | Faculty of Science > Statistics | |||||||||
| Library of Congress Subject Headings (LCSH): | Gaussian processes, Markov processes, Monte Carlo method | |||||||||
| Journal or Publication Title: | Computational Statistics & Data Analysis | |||||||||
| Publisher: | Elsevier Science Ltd | |||||||||
| ISSN: | 0167-9473 | |||||||||
| Official Date: | February 2018 | |||||||||
| Dates: |
|
|||||||||
| Volume: | 118 | |||||||||
| DOI: | 10.1016/j.csda.2017.09.002 | |||||||||
| Status: | Peer Reviewed | |||||||||
| Publication Status: | Published | |||||||||
| Access rights to Published version: | Restricted or Subscription Access | |||||||||
| RIOXX Funder/Project Grant: |
|
Request changes or add full text files to a record
Repository staff actions (login required)
 |
View Item |
Downloads
Downloads per month over past year
