Feature extraction based on the Bhattacharyya distance

被引:185
作者
Choi, E [1 ]
Lee, C [1 ]
机构
[1] Yonsei Univ, Dept Elect & Elect Engn, Seodaemun Gu, Seoul 120749, South Korea
关键词
feature extraction; Bhattacharyya distance; Bayes error estimation; optimization; classification error;
D O I
10.1016/S0031-3203(03)00035-9
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we present a feature extraction method by utilizing an error estimation equation based on the Bhattacharyya distance. We propose to use classification errors in the transformed feature space, which are estimated using the error estimation equation, as a criterion for feature extraction. The construction of linear transformation for feature extraction is conducted using an iterative gradient descent algorithm, so that the estimated classification error is minimized. Due to the ability to predict error, it is possible to determine the minimum number of features required for classification. Experimental results show that the proposed feature extraction method compares favorably with conventional methods. (C) 2003 Pattern Recognition Society. Published by Elsevier Science Ltd. All rights reserved.
引用
收藏
页码:1703 / 1709
页数:7
相关论文
共 12 条
[1]  
BIEHL LL, 1982, P MACH PROC REM SENS
[2]   Pattern recognition using discriminative feature extraction [J].
Biem, A ;
Katagiri, S ;
Juang, BH .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 1997, 45 (02) :500-504
[3]   TOWARD BAYES-OPTIMAL LINEAR DIMENSION REDUCTION [J].
BUTUROVIC, LJ .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1994, 16 (04) :420-424
[4]  
Choi E, 2000, INT GEOSCI REMOTE SE, P2146, DOI 10.1109/IGARSS.2000.858336
[5]   Optimizing feature extraction for multiclass problems [J].
Choi, E ;
Lee, C .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2001, 39 (03) :521-528
[6]   OPTIMAL SET OF DISCRIMINANT VECTORS [J].
FOLEY, DH ;
SAMMON, JW .
IEEE TRANSACTIONS ON COMPUTERS, 1975, C 24 (03) :281-289
[7]   APPLICATION OF KARHUNEN-LOEVE EXPANSION TO FEATURE SELECTION AND ORDERING [J].
FUKUNAGA, K ;
KOONTZ, WLG .
IEEE TRANSACTIONS ON COMPUTERS, 1970, C 19 (04) :311-&
[8]  
Fukunaga K., 1990, INTRO STAT PATTERN R
[9]   Bayes error evaluation of the Gaussian ML classifier [J].
Lee, C ;
Choi, E .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2000, 38 (03) :1471-1475
[10]   FEATURE-EXTRACTION BASED ON DECISION BOUNDARIES [J].
LEE, CH ;
LANDGREBE, DA .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1993, 15 (04) :388-400