The Library
Internal consistency of survey respondents’ forecasts: evidence based on the Survey of Professional Forecasters
Tools
Clements, Michael P. (2006) Internal consistency of survey respondents’ forecasts: evidence based on the Survey of Professional Forecasters. Working Paper. Coventry: University of Warwick, Department of Economics. (Warwick economic research papers).

PDF
WRAP_Clements_twerp_772.pdf  Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader Download (264Kb) 
Official URL: http://www2.warwick.ac.uk/fac/soc/economics/resear...
Abstract
We ask whether the different types of forecasts made by individual survey respondents are mutually consistent, using the SPF survey data. We compare the point forecasts and central tendencies of probability distributions matched by individual respondent, and compare the forecast probabilities of declines in output with the probabilities implied by the probability distributions. When the expected associations between these different types of forecasts do not hold for some individuals, we consider whether the discrepancies we observe are consistent with rational behaviour by agents with asymmetric loss functions.
Item Type:  Working or Discussion Paper (Working Paper) 

Subjects:  H Social Sciences > HB Economic Theory 
Divisions:  Faculty of Social Sciences > Economics 
Library of Congress Subject Headings (LCSH):  National Bureau of Economic Research , Economic forecasting, Rational expectations (Economic theory), Probabilities, Macroeconomics 
Series Name:  Warwick economic research papers 
Publisher:  University of Warwick, Department of Economics 
Place of Publication:  Coventry 
Date:  16 October 2006 
Number:  No.772 
Number of Pages:  29 
Status:  Not Peer Reviewed 
Access rights to Published version:  Open Access 
References:  Andersen, T. G., Bollerslev, T., Diebold, F. X., and Labys, P. (2003). Modelling and forecasting realized volatility. Econometrica, 71, 579�625. Anderson, T. G., and Bollerslev, T. (1998). Answering the skeptics: Yes, standard volatility models do provide accuate forecasts. International Economic Review, 39, 885�905. Baillie, R. T., and Bollerslev, T. (1992). Prediction in dynamic models with timedependent conditional variances. Journal of Econometrics, 52, 91�113. Berkowitz, J. (2001). Testing density forecasts, with applications to risk management. Journal of Business and Economic Statistics, 19, 465�474. Bollerslev, T. (1986). Generalised autoregressive conditional heteroskedasticity. Journal of Econometrics, 51, 307�327. Bomberger, W. A. (1996). Disagreement as a measure of uncertainty. Journal of Money, Credit and Banking, 28, 381�392. Capistrán, C., and Timmermann, A. (2005). Disagreement and biases in inflation forecasts. Mimeo, Banco de México and UCSD. Christoffersen, P. F. (1998). Evaluating interval forecasts. International Economic Review, 39, 841�862. Christoffersen, P. F., and Diebold, F. X. (1997). Optimal prediction under asymmetric loss. Econometric Theory, 13, 808�817. Clements, M. P. (2006). Evaluating the Survey of Professional Forecasters probability distributions of expected inflation based on derived event probability forecasts. Empirical Economics, 31, No. 1, 49�64. Croushore, D. (1993). Introducing: The Survey of Professional Forecasters. Federal Reserve Bank of Philadelphia Business Review, November/December, 3�13. Croushore, D., and Stark, T. (2001). A realtime data set for macroeconomists. Journal of Econometrics, 105(November), 111�130. Croushore, D., and Stark, T. (2003). A realtime data set for macroeconomists: Does the data vintage matter?. The Review of Economics and Statistics, 85(3), 605�617. Davies, A., and Lahiri, K. (1995). A new framework for analyzing survey forecasts using threedimensional panel data. Journal of Econometrics, 68, 205�227. Davies, A., and Lahiri, K. (1999). Reexamining the rational expectations hypothesis using panel data on multiperiod forecasts. In Hsiao, C., Lahiri, K., Lee, L. F., and Pesaran, M. H. (eds.), Analysis of Panels and Limited Dependent Variable Models, pp. 226�254: Cambridge University Press. Dawid, A. P. (1986). Probability forecasting. In Kotz, S., Johnson, N. L., and Read, C. B. (eds.), Encyclopedia of Statistical Sciences, vol. 7, pp. 210�218: John Wiley and Sons. Diebold, F. X., Gunther, T. A., and Tay, A. S. (1998). Evaluating density forecasts: With applications to �nancial risk management. International Economic Review, 39, 863�883. Diebold, F. X., Hahn, J. Y., and Tay, A. S. (1999a). Multivariate density forecast evaluation and calibration in �nancial risk management: High frequency returns on foreign exchange. Review of Economics and Statistics, 81, 661�673. Diebold, F. X., Tay, A. S., and Wallis, K. F. (1999b). Evaluating density forecasts of inflation: The Survey of Professional Forecasters. In Engle, R. F., and White, H. (eds.), Cointegration, Causality and Forecasting: A Festschrift in Honour of Clive Granger, pp. 76�90. Oxford: Oxford University Press. Ehrbeck, T., and Waldmann, R. (1996). Why are professional forecasters biased? agency versus behavioral explanations. The Quarterly Journal of Economics, 111(1), 21�40. Elliott, G., Komunjer, I., and Timmermann, A. (2005a). Biases in macroeconomic forecasts: Irrationality or asymmetric loss. Mimeo, UCSD. Elliott, G., Komunjer, I., and Timmermann, A. (2005b). Estimation and testing of forecast rationality under flexible loss. Review of Economic Studies, 72, 1107�1125. Engelberg, J., Manski, C. F., andWilliams, J. (2006). Comparing the point predictions and subjective probability distributions of professional forecasters. Mimeo, Kellogg School of Management and Department of Economics, Northwestern University. Engle, R. F. (1982). Autoregressive conditional heteroscedasticity, with estimates of the variance of United Kingdom inflation. Econometrica, 50, 987�1007. Faust, J., Rogers, J. H., and Wright, J. H. (2003). Exchange rate forecasting: The errors we've really made. Journal of International Economic Review, 60, 35�39. Faust, J., Rogers, J. H., and Wright, J. H. (2005). News and noise in G7 GDP announcements. Journal of Money, Credit and Banking, 37 (3), 403�417. Figlewski, S., and Wachtel, P. (1981). The formation of inflationary expectations. Review of Economics and Statistics, 63, 1�10. Fildes, R. A., and Stekler, H. O. (2002). The state of macroeconomic forecasting. Journal of Macroeconomics, 24. Giordani, P., and Söderlind, P. (2003). Inflation forecast uncertainty. European Economic Review, 74, 1037�1060. Granger, C. W. J. (1969). Prediction with a generalized cost of error function. Operations Research Quarterly, 20, 199�207. Granger, C. W. J., and Pesaran, M. H. (2000a). A decisionbased approach to forecast evaluation. In Chan, W. S., Li, W. K., and Tong, H. (eds.), Statistics and Finance: An Interface, pp. 261�278: London: Imperial College Press. Granger, C. W. J., and Pesaran, M. H. (2000b). Economic and statistical measures of forecast accuracy. Journal of Forecasting, 19, 537�560. Granger, C. W. J., White, H., and Kamstra, M. (1989). Interval forecasting: An analysis based upon ARCHquantile estimators. Journal of Econometrics, 40, 87�96. Hong, Y. (2001). Evaluation of outofsample probability density forecasts with applications to stock prices. Manuscript, Department of Economics, Cornell University. Keane, M. P., and Runkle, D. E. (1990). Testing the rationality of price forecasts: new evidence from panel data. American Economic Review, 80, 714�735. Koenig, E. F., Dolmas, S., and Piger, J. (2003). The use and abuse of realtime data in economic forecasting. The Review of Economics and Statistics, 85(3), 618�628. Laster, D., Bennett, P., and Geoum, I. S. (1999). Rational bias in macroeconomic forecasts. The Quarterly Journal of Economics, 114(1), 293�318. McNees, S. K. (1995). Forecast uncertainty: Can it be measured?. Federal reserve Bank of New York Discussion Paper. Mincer, J., and Zarnowitz, V. (1969). The evaluation of economic forecasts. In Mincer, J. (ed.), Economic Forecasts and Expectations. New York: National Bureau of Economic Research. Ottaviani, M., and Sorensen, P. N. (2006). The strategy of professional forecasting. Journal of Financial Economics, 81, 441�466. Patterson, K. D. (1995). An integrated model of the data measurement and data generation processes with an application to consumers' expenditure. Economic Journal, 105, 54�76. Patterson, K. D. (2003). Exploiting information in vintages of timeseries data. International Journal of Forecasting, 19, 177�197. Patton, A. J., and Timmermann, A. (2006). Testing forecast optimality under unknown loss. Mimeo, London School of Economics and UCSD. Pesaran, M. H., and Skouras, S. (2002). Decisionbased methods for forecast evaluation. In Clements, M. P., and Hendry, D. F. (eds.), A Companion to Economic Forecasting, pp. 241�267: Oxford: Blackwells. Pesaran, M. H., and Weale, M. (2006). Survey expectations. In Elliott, G., Granger, C., and Timmermann, A. (eds.), Handbook of Economic Forecasting, Volume 1. Handbook of Economics 24, pp. 715�776: Elsevier, HorthHolland. Rich, R., and Tracy, J. (2003). Modeling uncertainty: Predictive accuracy as a proxy for predictive con�dence. Federal Reserve Bank of New York Staff Reports, no. 161, February. Rich, R. W., and Butler, J. S. (1998). Disagreement as a measure of uncertainty: A comment on Bomberger. Journal of Money, Credit and Banking, 30, 411�419. Stekler, H. O. (2002). The rationality and efficiency of individuals' forecasts. In Clements, M. P., and Hendry, D. F. (eds.), A Companion to Economic Forecasting, pp. 222�240: Oxford: Blackwells. Thompson, S. B. (2002). Evaluating the goodness of �fit of conditional distributions, with an application to affine term structure models. Manuscript, Harvard University. Varian, H. R. (1975). A Bayesian approach to real estate assessment. In Fienberg, S. E., and Zellner, A. (eds.), Studies in Bayesian econometrics and statistics in honor of Leonard J. Savage, pp. 195�208. Amsterdam: North Holland. Zarnowitz, V. (1969). The new ASANBER Survey of Forecasts by Economic Statisticians. The American Statistician, 23, No. 1, 12�16. Zarnowitz, V. (1985). Rational expectations and macroeconomic forecasts. Journal of Business and Economic Statistics, 3, 293�311. Zarnowitz, V., and Lambros, L. A. (1987). Consensus and uncertainty in economic prediction. Journal of Political Economy, 95, 591�621. Zellner, A. (1986). Biased predictors, rationality and the evaluation of forecasts. Economics Letters, 21, 45�48. 
URI:  http://wrap.warwick.ac.uk/id/eprint/1427 
Actions (login required)
View Item 