Classification via kernel product estimators

被引:20
作者
Cooley, CA [1 ]
MacEachern, SN [1 ]
机构
[1] Ohio State Univ, Dept Stat, Columbus, OH 43210 USA
关键词
bias-variance trade-off; density estimation; discriminant analysis; nonparametric classification;
D O I
10.1093/biomet/85.4.823
中图分类号
Q [生物科学];
学科分类号
07 ; 0710 ; 09 ;
摘要
Multivariate kernel density estimation is often used as the basis for a nonparametric classification technique. However, the multivariate kernel classifier suffers from the curse of dimensionality, requiring inordinately large sample sizes to achieve a reasonable degree of accuracy in high dimensional settings. A variance stabilising approach to kernel classification can be motivated through an alternative interpretation of linear and quadratic discriminant analysis in which rotations of the coordinate axes are employed to obtain an assumed mutual independence among the components of the rotated data. This alternative method, which we call the method of kernel product estimators, performs well in a variety of examples, including a 20-dimensional target recognition problem.
引用
收藏
页码:823 / 833
页数:11
相关论文
共 23 条
[1]  
Anderson T., 1984, INTRO MULTIVARIATE S
[2]  
BARRON AR, 1988, COMPUTING SCI STATIS, P192
[3]   SmcHD1, containing a structural-maintenance-of-chromosomes hinge domain, has a critical role in X inactivation [J].
Blewitt, Marnie E. ;
Gendrel, Anne-Valerie ;
Pang, Zhenyi ;
Sparrow, Duncan B. ;
Whitelaw, Nadia ;
Craig, Jeffrey M. ;
Apedaile, Anwyn ;
Hilton, Douglas J. ;
Dunwoodie, Sally L. ;
Brockdorff, Neil ;
Kay, Graham F. ;
Whitelaw, Emma .
NATURE GENETICS, 2008, 40 (05) :663-669
[4]  
BREIMAN L, 1985, J AM STAT ASSOC, V80, P580, DOI 10.2307/2288473
[5]   NEURAL NETWORKS - A REVIEW FROM A STATISTICAL PERSPECTIVE [J].
CHENG, B ;
TITTERINGTON, DM .
STATISTICAL SCIENCE, 1994, 9 (01) :2-30
[6]   PROJECTION PURSUIT REGRESSION [J].
FRIEDMAN, JH ;
STUETZLE, W .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 1981, 76 (376) :817-823
[7]   MULTIVARIATE ADAPTIVE REGRESSION SPLINES [J].
FRIEDMAN, JH .
ANNALS OF STATISTICS, 1991, 19 (01) :1-67
[8]  
Fukunaga K., 1972, Introduction to statistical pattern recognition
[9]   ANALYSIS OF HIDDEN UNITS IN A LAYERED NETWORK TRAINED TO CLASSIFY SONAR TARGETS [J].
GORMAN, RP ;
SEJNOWSKI, TJ .
NEURAL NETWORKS, 1988, 1 (01) :75-89
[10]  
Hand DavidJ., 1982, KERNEL DISCRIMINANT