Parameter Estimation Error in Tests of Predictive Performance under Discrete Loss Functions

  1. Eransus Armendáriz, Francisco Javier
  2. Novales Cinca, Alfonso
Revista:
Documentos de Trabajo (ICAE)

ISSN: 2341-2356

Año de publicación: 2014

Número: 22

Páginas: 1-30

Tipo: Documento de Trabajo

DIALNET GOOGLE SCHOLAR

Otras publicaciones en: Documentos de Trabajo (ICAE)

Resumen

We analyze the effect of parameter estimation error on the size of unconditional population level tests of predictive ability when they are implemented under a class of loss functions we refer to as �discrete functions�. The analysis is restricted to linear models in stationary variables. We obtain analytical results for no nested models guaranteeing asymptotic irrelevance of parameter estimation error under a plausible predictive environment and three subsets of discrete loss functions that seem quite appropriate for many economic applications. For nested models, we provide some Monte Carlo evidence suggesting that the asymptotic distribution of the Diebold and Mariano (1995) test is relatively robust to parameter estimation error in many cases if it is implemented under discrete loss functions, unlike what happens under the squared forecast error or the absolute value error loss functions.

Referencias bibliográficas

  • Blaskowitz, O. and Herwartz, H. (2011). On Economic Evaluation of Directional Forecasts, International Journal of Forecasting, in press.
  • Clark, T. and McCracken, M.W. (2001). Tests of Equal Forecast Accuracy and Encompassing for Nested Models, Journal of Econometrics 105, 85-110.
  • Clark, T. and McCracken, M.W. (2010). Testing for Unconditional Predictive Ability, Working Paper 2010-031 A, Federal Reserve Bank of St. Louis.
  • Clark, T. and West, K.D. (2007). Approximately Normal Tests for Equal Predictive Accuracy in Nested Models, Journal of Econometrics 138, 291-311.
  • Corradi, V., Swanson, N. and Olivetti, C. (2001). Predictive Ability with Cointegrated Variables, Journal of Econometrics 104, 315-358.
  • Diebold, F.X. and Mariano, R. (1995). Comparing Predictive Accuracy, Journal of Business and Economic Statistics, 13, 253-263.
  • Giacomini, R. and White, H. (2006). Tests of Conditional Predictive Ability, Econometrica, 74, 1545-1578.
  • Granger, C.W.J. and Machina, M.J. (2006), Forecasting and Decision Theory, in Handbook of Economic Forecasting, Elliot G., Granger C.W.J., Timmermann A. (eds), North Holland.
  • Granger, C.W.J. and Pesaran, M.H. (2000). Economic and Statistical Measures of Forecast Accuracy, Journal of Forecasting, 19, 537-560.
  • McCracken, M.W. (2000). Robust Out of Sample Inference, Journal of Econometrics, 99, 195-223.
  • McCracken, M.W. (2004). Parameter Estimation and Tests of Equal Forecast Accuracy between nonnested Models, International Journal of Forecasting, 20, 503-514.
  • McCracken, M.W. (2007). Asymptotics for Out of Sample Tests of Granger Causality, Journal of Econometrics, 140, 717-752.
  • Pesaran, M.H. and Skouras, S. (2002). Decision-based Methods for Forecast Evaluation, in A companion to Economic Forecasting, Clements, M.P. and Hendry, D.F. (eds), Oxford, Blackwell Publishing.
  • Pesaran, M.H. and Timmermann, A. (2009). Testing Dependence among Serially Correlated Multi-category Variables", Journal of the American Statistical Association, 104 (485), 325-337.
  • Rossi, B. (2005). Testing Long-Horizon Predictive Ability with High Persistence, and the Meese-Rogo§ Puzzle, International Economic Review, 46, 61-92.
  • West, K.D. (1996). Asymptotic Inference about Predictive Ability, Econometrica, 64, 1067-1084.
  • West, K.D. (2006), Forecast Evaluation, in Handbook of Economic Forecasting, Elliot G., Granger C.W.J., Timmermann A. (eds), North Holland.
Fuente de los datos: Dialnet