The Library
Properties of the bridge sampler with a focus on splitting the MCMC sample
Tools
Wong, Jackie S. T., Forster, Jonathan J. and Smith, Peter W. F. (2020) Properties of the bridge sampler with a focus on splitting the MCMC sample. Statistics and Computing, 30 (4). pp. 799-816. doi:10.1007/s11222-019-09918-5 ISSN 0960-3174.
Research output not available from this repository.
Request-a-Copy directly from author or use local Library Get it For Me service.
Official URL: http://dx.doi.org/10.1007/s11222-019-09918-5
Abstract
Computation of normalizing constants is a fundamental mathematical problem in various disciplines, particularly in Bayesian model selection problems. A sampling-based technique known as bridge sampling (Meng and Wong in Stat Sin 6(4):831–860, 1996) has been found to produce accurate estimates of normalizing constants and is shown to possess good asymptotic properties. For small to moderate sample sizes (as in situations with limited computational resources), we demonstrate that the (optimal) bridge sampler produces biased estimates. Specifically, when one density (we denote as p2) is constructed to be close to the target density (we denote as p1) using method of moments, our simulation-based results indicate that the correlation-induced bias through the moment-matching procedure is non-negligible. More crucially, the bias amplifies as the dimensionality of the problem increases. Thus, a series of theoretical as well as empirical investigations is carried out to identify the nature and origin of the bias. We then examine the effect of sample size allocation on the accuracy of bridge sampling estimates and discovered that one possibility of reducing both the bias and standard error with a small increase in computational effort is by drawing extra samples from the moment-matched density p2 (which we assume easy to sample from), provided that the evaluation of p1 is not too expensive. We proceed to show how the simple adaptive approach we termed “splitting” manages to alleviate the correlation-induced bias at the expense of a higher standard error, irrespective of the dimensionality involved. We also slightly modified the strategy suggested by Wang et al. (Warp bridge sampling: the next generation, Preprint, 2019. arXiv:1609.07690) to address the issue of the increase in standard error due to splitting, which is later generalized to further improve the efficiency. We conclude the paper by offering our insights of the application of a combination of these adaptive methods to improve the accuracy of bridge sampling estimates in Bayesian applications (where posterior samples are typically expensive to generate) based on the preceding investigations, with an application to a practical example.
Item Type: | Journal Article | ||||||||
---|---|---|---|---|---|---|---|---|---|
Divisions: | Faculty of Science, Engineering and Medicine > Science > Statistics | ||||||||
Journal or Publication Title: | Statistics and Computing | ||||||||
Publisher: | Springer | ||||||||
ISSN: | 0960-3174 | ||||||||
Official Date: | July 2020 | ||||||||
Dates: |
|
||||||||
Volume: | 30 | ||||||||
Number: | 4 | ||||||||
Page Range: | pp. 799-816 | ||||||||
DOI: | 10.1007/s11222-019-09918-5 | ||||||||
Status: | Peer Reviewed | ||||||||
Publication Status: | Published | ||||||||
Access rights to Published version: | Restricted or Subscription Access |
Request changes or add full text files to a record
Repository staff actions (login required)
View Item |