NONLINEAR PRINCIPAL COMPONENT ANALYSIS USING AUTOASSOCIATIVE NEURAL NETWORKS

被引:1936
作者
KRAMER, MA
机构
[1] Laboratory for Intelligent, Dept. of Chemical Engineering, Massachusetts Institute of Technology, Cambridge, Massachusetts
关键词
D O I
10.1002/aic.690370209
中图分类号
TQ [化学工业];
学科分类号
0817 ;
摘要
Nonlinear principal component analysis is a novel technique for multivariate data analysis, similar to the well-known method of principal component analysis. NLPCA, like PCA, is used to identify and remove correlations among problem variables as an aid to dimensionality reduction, visualization, and exploratory data analysis. While PCA identifies only linear correlations between variables, NLPCA uncovers both linear and nonlinear correlations, without restriction on the character of the nonlinearities present in the data. NLPCA operates by training a feedforward neural network to perform the identity mapping, where the network inputs are reproduced at the output layer. The network contains an internal "bottleneck" layer (containing fewer nodes than input or output layers), which forces the network to develop a compact representation of the input data, and two additional hidden layers. The NLPCA method is demonstrated using time-dependent, simulated batch reaction data. Results show that NLPCA successfully reduces dimensionality and produces a feature space map resembling the actual distribution of the underlying system parameters.
引用
收藏
页码:233 / 243
页数:11
相关论文
共 32 条
[1]  
ACKLEY DH, 1985, COGNITIVE SCI, V9, P147
[2]   NEURAL NETWORKS AND PRINCIPAL COMPONENT ANALYSIS - LEARNING FROM EXAMPLES WITHOUT LOCAL MINIMA [J].
BALDI, P ;
HORNIK, K .
NEURAL NETWORKS, 1989, 2 (01) :53-58
[3]  
BALLARD DH, 1987, P C AI AAAI 87, V1, P279
[4]  
Chauvin Y., 1989, P 11 ANN C COGN SCI P 11 ANN C COGN SCI, P580
[5]  
COTTRELL GW, 1987, 9TH P ANN C COGN SCI, P461
[6]  
Cybenko G., 1989, Mathematics of Control, Signals, and Systems, V2, P303, DOI 10.1007/BF02551274
[7]  
Duda R. O., 1973, PATTERN CLASSIFICATI, V3
[8]  
FAHLMAN SE, 1989, P CONNECTIONIST MODE
[9]  
FOLDIAK P, 1989, JUN P IJCNN INT JOIN, V1, P401
[10]   APPLICATION OF KARHUNEN-LOEVE EXPANSION TO FEATURE SELECTION AND ORDERING [J].
FUKUNAGA, K ;
KOONTZ, WLG .
IEEE TRANSACTIONS ON COMPUTERS, 1970, C 19 (04) :311-&