The Library
Piecewise deterministic Markov processes for continuous-time Monte Carlo
Tools
Fearnhead, Paul, Bierkens, Joris, Pollock, Murray and Roberts, Gareth O. (2018) Piecewise deterministic Markov processes for continuous-time Monte Carlo. Statistical Science, 33 (3). pp. 386-412. doi:10.1214/18-STS648 ISSN 0883-4237.
|
PDF
WRAP-piecewise-deterministic-Markov-processes-continuous-time-Monte-Carlo-Roberts-2018.pdf - Published Version - Requires a PDF viewer. Download (1132Kb) | Preview |
Official URL: http://dx.doi.org/10.1214/18-STS648
Abstract
Recently, there have been conceptually new developments in Monte Carlo methods through the introduction of new MCMC and sequential Monte Carlo (SMC) algorithms which are based on continuous-time, rather than discrete-time, Markov processes. This has led to some fundamentally new Monte Carlo algorithms which can be used to sample from, say, a posterior distribution. Interestingly, continuous-time algorithms seem particularly well suited to Bayesian analysis in big-data settings as they need only access a small sub-set of data points at each iteration, and yet are still guaranteed to target the true posterior distribution. Whilst continuous-time MCMC and SMC methods have been developed independently we show here that they are related by the fact that both involve simulating a piecewise deterministic Markov process. Furthermore, we show that the methods developed to date are just specific cases of a potentially much wider class of continuous-time Monte Carlo algorithms. We give an informal introduction to piecewise deterministic Markov processes, covering the aspects relevant to these new Monte Carlo algorithms, with a view to making the development of new continuous-time Monte Carlo more accessible. We focus on how and why sub-sampling ideas can be used with these algorithms, and aim to give insight into how these new algorithms can be implemented, and what are some of the issues that affect their efficiency.
Item Type: | Journal Article | |||||||||
---|---|---|---|---|---|---|---|---|---|---|
Subjects: | Q Science > QA Mathematics Q Science > QC Physics |
|||||||||
Divisions: | Faculty of Science, Engineering and Medicine > Science > Statistics | |||||||||
Library of Congress Subject Headings (LCSH): | Bayesian field theory, Bayesian statistical decision theory, Big data, Monte Carlo method, Markov processes | |||||||||
Journal or Publication Title: | Statistical Science | |||||||||
Publisher: | American Institute of Mathematical Statistics | |||||||||
ISSN: | 0883-4237 | |||||||||
Official Date: | 2018 | |||||||||
Dates: |
|
|||||||||
Volume: | 33 | |||||||||
Number: | 3 | |||||||||
Page Range: | pp. 386-412 | |||||||||
DOI: | 10.1214/18-STS648 | |||||||||
Status: | Peer Reviewed | |||||||||
Publication Status: | Published | |||||||||
Access rights to Published version: | Restricted or Subscription Access | |||||||||
Date of first compliant deposit: | 25 February 2019 | |||||||||
Date of first compliant Open Access: | 25 February 2019 | |||||||||
RIOXX Funder/Project Grant: |
|
|||||||||
Related URLs: | ||||||||||
Open Access Version: |
Request changes or add full text files to a record
Repository staff actions (login required)
View Item |
Downloads
Downloads per month over past year