Incremental extreme learning machine with fully complex hidden nodes

被引:213
作者
Huang, Guang-Bin [1 ]
Li, Ming-Bin [1 ]
Chen, Lei [2 ]
Siew, Chee-Kheong [1 ]
机构
[1] Nanyang Technol Univ, Sch Elect & Elect Engn, Singapore 639798, Singapore
[2] Natl Univ Singapore, Sch Comp, Singapore 117543, Singapore
关键词
feedforward networks; complex activation function; constructive networks; ELM; I-ELM; channel equalization;
D O I
10.1016/j.neucom.2007.07.025
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Huang et al. [Universal approximation using incremental constructive feedforward networks with random hidden nodes, IEEE Trans. Neural Networks 17(4) (2006) 879-892] has recently proposed an incremental extreme learning machine (I-ELM), which randomly adds hidden nodes incrementally and analytically determines the output weights. Although hidden nodes are generated randomly, the network constructed by I-ELM remains as a universal approximator. This paper extends I-ELM from the real domain to the complex domain. We show that. as long as the hidden layer activation function is complex continuous discriminatory or complex bounded nonlinear piecewise continuous. I-ELM can still approximate any target functions in the complex domain. The universal capability of the I-ELM in the complex domain is further verified by two function approximations and one channel equalization problems. (c) 2007 Elsevier B.V. All rights reserved.
引用
收藏
页码:576 / 583
页数:8
相关论文
共 27 条
[1]  
[Anonymous], INT J INF TECHNOL
[2]   Multilayer perceptrons to approximate complex valued functions [J].
Arena, P ;
Fortuna, L ;
Re, R ;
Xibilia, MG .
INTERNATIONAL JOURNAL OF NEURAL SYSTEMS, 1995, 6 (04) :435-446
[3]   UNIVERSAL APPROXIMATION BOUNDS FOR SUPERPOSITIONS OF A SIGMOIDAL FUNCTION [J].
BARRON, AR .
IEEE TRANSACTIONS ON INFORMATION THEORY, 1993, 39 (03) :930-945
[4]  
Baum E. B., 1988, Journal of Complexity, V4, P193, DOI 10.1016/0885-064X(88)90020-9
[5]  
Broomhead D. S., 1988, Complex Systems, V2, P321
[6]   CHANNEL EQUALIZATION USING ADAPTIVE COMPLEX RADIAL BASIS FUNCTION NETWORKS [J].
CHA, I ;
KASSAM, SA .
IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 1995, 13 (01) :122-131
[7]   COMPLEX-VALUED RADIAL BASIS FUNCTION NETWORK .2. APPLICATION TO DIGITAL-COMMUNICATIONS CHANNEL EQUALIZATION [J].
CHEN, S ;
MCLAUGHLIN, S ;
MULGREW, B .
SIGNAL PROCESSING, 1994, 36 (02) :175-188
[8]   COMPLEX-VALUED RADIAL BASIS FUNCTION NETWORK .1. NETWORK ARCHITECTURE AND LEARNING ALGORITHMS [J].
CHEN, S ;
MCLAUGHLIN, S ;
MULGREW, B .
SIGNAL PROCESSING, 1994, 35 (01) :19-31
[9]   Communication channel equalization using complex-valued minimal radial basis function neural networks [J].
Deng, JP ;
Sundararajan, N ;
Saratchandran, P .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 2002, 13 (03) :687-696
[10]   Smooth function approximation using neural networks [J].
Ferrari, S ;
Stengel, RF .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 2005, 16 (01) :24-38