Focused local learning with wavelet neural networks

被引:33
作者
Rying, EA
Bilbro, GL
Lu, JC
机构
[1] N Carolina State Univ, Dept Elect & Comp Engn, Raleigh, NC 27695 USA
[2] Georgia Inst Technol, Sch Ind & Syst Engn, Atlanta, GA 30332 USA
来源
IEEE TRANSACTIONS ON NEURAL NETWORKS | 2002年 / 13卷 / 02期
基金
美国国家科学基金会;
关键词
local error; objective function; wavelets;
D O I
10.1109/72.991417
中图分类号
TP18 [人工智能理论];
学科分类号
081104 [模式识别与智能系统]; 0812 [计算机科学与技术]; 0835 [软件工程]; 1405 [智能科学与技术];
摘要
In this paper, a novel objective function is presented that incorporates both local and global error as well as model parsimony in the construction of wavelet neural networks. Two methods are presented to assist in the minimization of this objective function, especially the local error term. First, during network initialization, a locally adaptive grid is utilized to include candidate wavelet basis functions whose local support addresses the local error of the local feature set. This set can be either user-defined or determined using information derived from the wavelet transform modulus maxima (WTMM) representation. Second, during network construction, a new selection procedure based on a subspace projection operator is presented to help focus the selection of wavelet basis functions to reduce the local error. Simulation results demonstrate the effectiveness of these methodologies in minimizing local and global error while maintaining model parsimony and incurring a minimal increase on computational complexity.
引用
收藏
页码:304 / 319
页数:16
相关论文
共 20 条
[1]
WAVE-NET - A MULTIRESOLUTION, HIERARCHICAL NEURAL NETWORK WITH LOCALIZED LEARNING [J].
BAKSHI, BR ;
STEPHANOPOULOS, G .
AICHE JOURNAL, 1993, 39 (01) :57-81
[2]
LOCAL LEARNING ALGORITHMS [J].
BOTTOU, L ;
VAPNIK, V .
NEURAL COMPUTATION, 1992, 4 (06) :888-900
[3]
ORTHOGONAL LEAST-SQUARES METHODS AND THEIR APPLICATION TO NON-LINEAR SYSTEM-IDENTIFICATION [J].
CHEN, S ;
BILLINGS, SA ;
LUO, W .
INTERNATIONAL JOURNAL OF CONTROL, 1989, 50 (05) :1873-1896
[4]
Regularized orthogonal least squares algorithm for constructing radial basis function networks [J].
Chen, S ;
Chng, ES ;
Alkadhimi, K .
INTERNATIONAL JOURNAL OF CONTROL, 1996, 64 (05) :829-837
[5]
Combined genetic algorithm optimization and regularized orthogonal least squares learning for radial basis function networks [J].
Chen, S ;
Wu, Y ;
Luk, BL .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 1999, 10 (05) :1239-1243
[6]
Adapting to unknown smoothness via wavelet shrinkage [J].
Donoho, DL ;
Johnstone, IM .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 1995, 90 (432) :1200-1224
[7]
ECHAUZ J, 1995, THESIS GEORGIA I TEC
[8]
Accurate radial wavelet neural-network model for efficient CAD modelling of microstrip discontinuities [J].
Harkouss, Y ;
Ngoya, E ;
Rousset, J ;
Argollo, D .
IEE PROCEEDINGS-MICROWAVES ANTENNAS AND PROPAGATION, 2000, 147 (04) :277-283
[9]
Haykin S., 1999, Neural Networks: A Comprehensive Foundation, V2nd ed
[10]
Feature-preserving data compression of stamping tonnage information using wavelets [J].
Jin, JH ;
Shi, JJ .
TECHNOMETRICS, 1999, 41 (04) :327-339