The Library
Smooth particle filters for likelihood evaluation and maximisation
Tools
Pitt, Michael K. (2002) Smooth particle filters for likelihood evaluation and maximisation. Working Paper. Coventry: University of Warwick, Department of Economics. (Warwick economic research papers).

PDF
WRAP_Pitt_twerp651.pdf  Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader Download (596Kb) 
Official URL: http://www2.warwick.ac.uk/fac/soc/economics/resear...
Abstract
In this paper,a method is introduced for approximating the likelihood for the unknown parameters of a state space model.The approximation converges to the true likelihood as the simulation size goes to infinity. In addition,the approximating likelihood is continuous as a function of the unknown parameters under rather general conditions.The approach advocated is fast, robust and avoids many of the pitfalls associated with current techniques based upon importance sampling.We assess the performance of the method by considering a linear state space model, comparing the results with the Kalman filter, which delivers the true likelihood. We also apply the method to a nonGaussian state space model, the Stochastic Volatility model, finding that the approach is efficient and effective. Applications to continuous time finance models are also considered. A result is established which allows the likelihood to be estimated quickly and efficiently using the output from the general auxiliary particle filter.
Item Type:  Working or Discussion Paper (Working Paper) 

Subjects:  H Social Sciences > HB Economic Theory Q Science > QA Mathematics 
Divisions:  Faculty of Social Sciences > Economics 
Library of Congress Subject Headings (LCSH):  Sampling (Statistics), Kalman filtering, Stochastic processes, Statespace methods, Gaussian processes 
Series Name:  Warwick economic research papers 
Publisher:  University of Warwick, Department of Economics 
Place of Publication:  Coventry 
Date:  16 July 2002 
Number:  No.651 
Number of Pages:  44 
Status:  Not Peer Reviewed 
Access rights to Published version:  Open Access 
References:  Andrieu, C. & Doucet, A. (2002). Particle filtering for partially observed gaussian state space models. JRSSB forthcoming. Berzuini, C., Best, N. G., Gilks, W. R., & Larizza, C. (1997). Dynamic conditional independence models and Markov chain Monte Carlo methods. J. Am. Statist. Assoc. 92, 140312. Campbell, J. Y., Lo, A. W., & MacKinlay, A. C. (1997). The Econometrics of Financial Markets. Princeton University Press, Princeton, New Jersey. Carpenter, J. R., Clifford, P., & Fearnhead, P. (1997). Efficient implementation of particle filters for nonlinear systems. 4th Interim Report, DRA contract WSS/U1172, Department of Statistics, Oxford University. Carpenter, J. R., Clifford, P., & Fearnhead, P. (1999). An improved particle filter for nonlinear problems. IEE Proceedings on Radar, Sonar and Navigation 146, 2–7. Danielsson, J. & Richard, J. F. (1993). Accelerated Gaussian importance sampler with application to dynamic latent variable models. J. Appl. Econometrics 8, S153–S174. Reprinted as pp. 169–190 in van Dijk, H.K., A. Monfort and B.W. Brown(1995), Econometric Inference Using Simulation Techniques, Chichester: Wiley. Diebold, F. X. & Nerlove, M. (1989). The dynamics of exchange rate volatility: a multivariate latent factor ARCH model. J. Appl. Econometrics 4, 1–21. Doucet, A., de Freitas, J. F. G., & Gordon, N. (2000a). SequentialMonte Carlo Methods in Practice. Cambridge University Press, Cambridge. Doucet, A., Godsill, S., & Andrieu, C. (2000b). On sequential simulationbased methods for Bayesian filtering. Statistics and Computing 10, 197–208. Durbin, J. & Koopman, S. J. (1997). Monte Carlo maximum likelihood estimation of nonGaussian state space model. Biometrika 84, 669–84. Efron, B. & Tibshirani, R. J. (1993). An Introduction to the Bootstrap. Chapman & Hall, New York. Engle, R. F. (1995). ARCH: Selected Readings. Oxford University Press, Oxford. Eraker, B., Johannes, M., & Polson, N. (2003). The impact of jumps in volatility and returns. J. Finance Forthcoming. Gerlach, R., Carter, C., & Kohn, R. (1999). Diagnostics for time series analysis. J. Time Series Analysis 21. Forthcoming. Ghysels, E., Harvey, A. C., & Renault, E. (1996). Stochastic volatility. In Rao, C. R. & Maddala, G. S., editors, Statistical Methods in Finance, pages 119–191. NorthHolland, Amsterdam. Gordon, N. J., Salmond, D. J., & Smith, A. F. M. (1993). A novel approach to nonlinear and nonGaussian Bayesian state estimation. IEEProceedings F 140, 107–33. Harvey, A. C. (1993). Time Series Models. Harvester Wheatsheaf, Hemel Hempstead, 2nd edition. Harvey, A. C., Ruiz, E., & Sentana, E. (1992). Unobserved component time series models with ARCH disturbances. J. Econometrics 52, 129–158. Harvey, A. C., Ruiz, E., & Shephard, N. (1994). Multivariate stochastic variance models. Rev. Economic Studies 61, 247–64. Heston, S. L. (1993). A closedform solution for options with stochastic volatility, with applications to bond and currency options. Rev. Financial Studies 6, 327–343. Hull, J. & White, A. (1987). The pricing of options on assets with stochastic volatilities. J. Finance 42, 281–300. Hurzeler, M. & Kunsch, H. (1998). Monte Carlo approximations for general state space models. Journal of Computational and Graphical Statistics 7, 175–193. Isard, M. & Blake, A. (1996). Contour tracking by stochastic propagation of conditional density. Proceedings of the European Conference on Computer Vision, Cambridge 1, 343–356. Jacquier, E., Polson, N. G., & Rossi, P. E. (1994). Bayesian analysis of stochastic volatility models (with discussion). J. Business and Economic Statist. 12, 371–417. Kim, S., Shephard, N., & Chib, S. (1998). Stochastic volatility: likelihood inference and comparison with ARCH models. Rev. Economic Studies 65, 361–93. King, M., Sentana, E., & Wadhwani, S. (1994). Volatility and links between national stock markets. Econometrica 62, 901–933. Kitagawa, G. (1987). NonGaussian state space modelling of nonstationary time series. J. Am. Statist. Assoc. 82, 503–514. Kitagawa, G. (1996). Monte Carlo filter and smoother for nonGaussian nonlinear state space models. J. Computational and Graphical Statistics 5, 1–25. Künsch, H. R. (2000). State space and hidden markov models. In Klüppelberg, C., editor, Complex Stochastic Systems. Chapman and Hall. Forthcoming. Liu, J. & Chen, R. (1998). Sequential Monte Carlo methods for dynamic systems. J. American Statistical Association 93, 1032–1044. Liu, J. & West, M. (2000). Combined parameter and state estimation in simulationbased filtering. In Doucet, A., de Freitas, J. F. G., & Gordon, N., editors, Sequential Monte Carlo Methods in Practice. Cambridge University Press. Nelson, D. B. (1990). ARCH models as diffusion approximations. J. Econometrics 45, 7–38. Reprinted as pp. 176–192 in Engle, R.F.(1995), ARCH: Selected Readings, Oxford: Oxford University Press. Pitt, M. & Shephard, N. (2000). Auxiliary variable based particle filters. In Doucet, A., de Freitas, J. F. G., & Gordon, N., editors, Sequential Monte Carlo Methods in Practice. Cambridge University Press. Pitt, M. K. & Shephard, N. (1999). Filtering via simulation based on auxiliary particle filters. J. American Statistical Association 94, 590–599. Ripley, B. D. (1987). Stochastic Simulation. Wiley, New York. Rubin, D. B. (1988). Using the SIR algorithm to simulate posterior distributions. In Bernardo, J. M., DeGroot, M. H., Lindley, D. V., & Smith, A. F. M., editors, Bayesian Statistics 3, pages 395–402. Oxford University Press Press, Oxford. Shephard, N. (1996). Statistical aspects of ARCH and stochastic volatility. In Cox, D. R., Hinkley, D. V., & BarndorffNielson, O. E., editors, Time Series Models in Econometrics, Finance and Other Fields, pages 1–67. Chapman & Hall, London. Shephard, N. & Pitt, M. K. (1997). Likelihood analysis of nonGaussian measurement time series. Biometrika 84, 653–67. Silverman, B. W. (1986). Density Estimation for Statisticaland Data Analysis. Chapman & Hall, London. Smith, A. F. M. & Gelfand, A. E. (1992). Bayesian statistics without tears: a sampling re sampling perspective. American Statistican 46, 84–88. Taylor, S. J. (1994). Modelling stochastic volatility. Mathematical Finance 4, 183–204. West, M. (1992). Mixture models, Monte Carlo, Bayesian updating and dynamic models. Computer Science and Statistics 24, 325–333. West, M. & Harrison, J. (1997). Bayesian Forecasting and Dynamic Models. SpringerVerlag, New York, 2 edition. 
URI:  http://wrap.warwick.ac.uk/id/eprint/1536 
Actions (login required)
View Item 