A neural network ensemble method with jittered training data for time series forecasting

被引:140
作者
Zhang, G. Peter [1 ]
机构
[1] Georgia State Univ, Dept Managerial Sci, Atlanta, GA 30303 USA
关键词
neural networks; time series forecasting; ensemble; noise injection; experimental design;
D O I
10.1016/j.ins.2007.06.015
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Improving forecasting especially time series forecasting accuracy is an important yet often difficult task facing decision makers in many areas. Combining multiple models can be an effective way to improve forecasting performance. Recently, considerable research has been taken in neural network ensembles. Most of the work, however, is devoted to the classification type of problems. As time series problems are often more difficult to model due to issues such as autocorrelation and single realization at any particular time point, more research is needed in this area. In this paper, we propose a jittered ensemble method for time series forecasting and test its effectiveness with both simulated and real time series. The central idea of the jittered ensemble is adding noises to the input data and thus augments the original training data set to form models based on different but related training samples. Our results show that the proposed method is able to consistently outperform the single modeling approach with a variety of time series processes. We also find that relatively small ensemble sizes of 5 and 10 are quite effective in forecasting performance improvement. (C) 2007 Elsevier Inc. All rights reserved.
引用
收藏
页码:5329 / 5346
页数:18
相关论文
共 65 条
[1]   The effects of adding noise during backpropagation training on a generalization performance [J].
An, GZ .
NEURAL COMPUTATION, 1996, 8 (03) :643-674
[2]  
[Anonymous], 1992, Neural Network World
[3]   A hybrid genetic-neural architecture for stock indexes forecasting [J].
Armano, G ;
Marchesi, M ;
Murru, A .
INFORMATION SCIENCES, 2005, 170 (01) :3-33
[4]  
ATIYA FA, 1999, IEEE T NEURAL NETWOR, V10
[5]   Automatic neural network modeling for univariate time series [J].
Balkin, SD ;
Ord, JK .
INTERNATIONAL JOURNAL OF FORECASTING, 2000, 16 (04) :509-515
[7]   An empirical investigation of bias and variance in time series forecasting: Modeling considerations and error evaluation [J].
Berardi, VL ;
Zhang, GP .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 2003, 14 (03) :668-679
[8]  
Berkowitz J., 2000, Econ. Res., V19, P1, DOI DOI 10.1080/07474930008800457
[9]  
Bishop C. M, 1995, NEURAL NETWORKS PATT
[10]   TRAINING WITH NOISE IS EQUIVALENT TO TIKHONOV REGULARIZATION [J].
BISHOP, CM .
NEURAL COMPUTATION, 1995, 7 (01) :108-116