NATIONAL BUREAU OF ECONOMIC RESEARCH
NATIONAL BUREAU OF ECONOMIC RESEARCH

Forecast Evaluation of Small Nested Model Sets

Kirstin Hubrich, Kenneth D. West

NBER Working Paper No. 14601
Issued in December 2008
NBER Program(s):   AP   ME   TWP

We propose two new procedures for comparing the mean squared prediction error (MSPE) of a benchmark model to the MSPEs of a small set of alternative models that nest the benchmark. Our procedures compare the benchmark to all the alternative models simultaneously rather than sequentially, and do not require reestimation of models as part of a bootstrap procedure. Both procedures adjust MSPE differences in accordance with Clark and West (2007); one procedure then examines the maximum t-statistic, the other computes a chi-squared statistic. Our simulations examine the proposed procedures and two existing procedures that do not adjust the MSPE differences: a chi-squared statistic, and White's (2000) reality check. In these simulations, the two statistics that adjust MSPE differences have most accurate size, and the procedure that looks at the maximum t-statistic has best power. We illustrate our procedures by comparing forecasts of different models for U.S. inflation.

download in pdf format
   (324 K)

email paper

This paper is available as PDF (324 K) or via email.

An online appendix is available for this publication.

Acknowledgments

Machine-readable bibliographic record - MARC, RIS, BibTeX

Document Object Identifier (DOI): 10.3386/w14601

Published: Kirstin Hubrich & Kenneth D. West, 2010. "Forecast evaluation of small nested model sets," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(4), pages 574-594.

Users who downloaded this paper also downloaded these:
West and Clark t0326 Approximately Normal Tests for Equal Predictive Accuracy in Nested Models
Aruoba, Diebold, Nalewaik, Schorfheide, and Song w17421 Improving GDP Measurement: A Forecast Combination Perspective
 
Publications
Activities
Meetings
Data
People
About

Support
National Bureau of Economic Research, 1050 Massachusetts Ave., Cambridge, MA 02138; 617-868-3900; email: info@nber.org

Contact Us