Improved extreme learning machine for function approximation by encoding a priori information

被引:102
作者
Han, Fei
Huang, De-Shuang
机构
[1] Chinese Acad Sci, Hefei Inst Intelligent Machines, Intelligent Comp Lab, Hefei 230031, Anhui, Peoples R China
[2] Univ Sci & Technol China, Dept Automat, Hefei 230027, Peoples R China
基金
中国国家自然科学基金;
关键词
extreme learning machine; function approximation; the a priori information; generalization performance; convergence rate;
D O I
10.1016/j.neucom.2006.02.013
中图分类号
TP18 [人工智能理论];
学科分类号
081104 [模式识别与智能系统]; 0812 [计算机科学与技术]; 0835 [软件工程]; 1405 [智能科学与技术];
摘要
In this letter, a class of improved extreme learning machines (ELM) encoding a priori information is proposed to obtain better generalization performance and much faster convergence rate for function approximation. According to Fourier series expansion theory, the hidden neurons activation functions in the improved ELM are sine and cosine functions. In addition, the improved ELM analytically determines the output weights of neural networks. Finally, experimental results are given to verify the efficiency and effectiveness of the improved ELM. (c) 2006 Elsevier B.V. All rights reserved.
引用
收藏
页码:2369 / 2373
页数:5
相关论文
共 11 条
[1]
What Size Net Gives Valid Generalization? [J].
Baum, Eric B. ;
Haussler, David .
NEURAL COMPUTATION, 1989, 1 (01) :151-160
[2]
A neural root finder of polynomials based on root moments [J].
Huang, DS ;
Ip, HHS ;
Chi, ZR .
NEURAL COMPUTATION, 2004, 16 (08) :1721-1762
[3]
Finding roots of arbitrary high order polynomials based on neural network recursive partitioning method [J].
Huang, DS ;
Chi, ZR .
SCIENCE IN CHINA SERIES F-INFORMATION SCIENCES, 2004, 47 (02) :232-245
[4]
A constructive approach for finding arbitrary roots of polynomials by neural networks [J].
Huang, DS .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 2004, 15 (02) :477-491
[5]
Dilation method for finding close roots of polynomials based on constrained learning neural networks [J].
Huang, DS ;
Ip, HHS ;
Chi, ZR ;
Wong, HS .
PHYSICS LETTERS A, 2003, 309 (5-6) :443-451
[6]
Huang GB, 2004, IEEE IJCNN, P985
[7]
Immunological heterogeneity of multiple sclerosis in Sardinia and Sweden [J].
Huang, YM ;
Liu, X ;
Steffensen, K ;
Sanna, A ;
Arru, G ;
Fois, ML ;
Rosati, G ;
Sotgiu, S ;
Link, H .
MULTIPLE SCLEROSIS, 2005, 11 (01) :16-23
[8]
AN EFFICIENT CONSTRAINED TRAINING ALGORITHM FOR FEEDFORWARD NETWORKS [J].
KARRAS, DA ;
PERANTONIS, SJ .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 1995, 6 (06) :1420-1434
[9]
LIU YL, 1992, MATH ANAL LECT, V2, P106
[10]
Magnified gradient function with deterministic weight modification in adaptive learning [J].
Ng, SC ;
Cheung, CC ;
Leung, SH .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 2004, 15 (06) :1411-1423