The Chebyshev-Polynomials-Based unified model neural networks for function approximation

被引:136
作者
Lee, TT [1 ]
Jeng, JT [1 ]
机构
[1] Natl Taiwan Inst Technol, Dept Elect Engn, Taipei 106, Taiwan
来源
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS | 1998年 / 28卷 / 06期
关键词
function approximation; neural network;
D O I
10.1109/3477.735405
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, we propose the approximate transformable technique, which includes the direct transformation and indirect transformation, to obtain a Chebyshev-Polynomials-Based (CPB) unified model neural networks for feedforward/recurrent neural networks via Chebyshev polynomials approximation. Based on this approximate transformable technique, we have derived the relationship between the single-layer neural networks and multilayer perceptron neural networks. It is shown that the CPB unified model neural networks can be represented as a functional link networks that are based on Chebyshev polynomials, and those networks use the recursive least square method with forgetting factor as learning algorithm. It turns out that the CPB unified model neural networks not only has the same capability of universal approximator, but also has faster learning speed than conventional feedforward/recurrent neural networks. Furthermore, we have also derived the condition such that the unified model generating by Chebyshev polynomials is optimal in the sense of error least square approximation in the single variable case. Computer simulations show that the proposed method does have the capability of universal approximator in some functional approximation with considerable reduction in learning time.
引用
收藏
页码:925 / 935
页数:11
相关论文
共 44 条
[1]   NONLINEAR-SYSTEM IDENTIFICATION AND CONTROL-BASED ON NEURAL AND SELF-TUNING CONTROL [J].
ABDULAZIZ, A ;
FARSI, M .
INTERNATIONAL JOURNAL OF ADAPTIVE CONTROL AND SIGNAL PROCESSING, 1993, 7 (04) :297-307
[2]   A MULTILAYER NEURAL NETWORK WITH PIECEWISE-LINEAR STRUCTURE AND BACK-PROPAGATION LEARNING [J].
BATRUNI, R .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 1991, 2 (03) :395-403
[3]  
BROWN GG, 1994, ENI APPL ARTIF INTEL, V7, P227
[4]  
CHAPMAN R, 1990, P I ELECT ENG, V137
[5]   CONVENTIONAL MODELING OF THE MULTILAYER PERCEPTRON USING POLYNOMIAL BASIS FUNCTIONS [J].
CHEN, MS ;
MANRY, MT .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 1993, 4 (01) :164-166
[6]  
CHEN S, 1992, INT J CONTROL, V56, P319, DOI [10.1080/00207179208934317, 10.1080/00207179008934126]
[7]  
CHEN TP, 1995, IEEE T NEURAL NETWOR, V6, P25
[8]   UNIVERSAL APPROXIMATION TO NONLINEAR OPERATORS BY NEURAL NETWORKS WITH ARBITRARY ACTIVATION FUNCTIONS AND ITS APPLICATION TO DYNAMICAL-SYSTEMS [J].
CHEN, TP ;
CHEN, H .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 1995, 6 (04) :911-917
[10]  
Cybenko G., 1989, Mathematics of Control, Signals, and Systems, V2, P303, DOI 10.1007/BF02551274