Computational and space complexity analysis of SubXPCA

被引:10
作者
Kadappa, Vijayakumar [1 ]
Negi, Atul [2 ]
机构
[1] BMS Coll Engn, Dept Comp Applicat, Bangalore 560019, Karnataka, India
[2] Univ Hyderabad, Sch Comp & Informat Sci, AI Lab, Hyderabad 500046, Andhra Pradesh, India
关键词
Dimensionality reduction; Feature extraction; Principal component analysis; Feature partitioning; Space complexity; Time complexity; PRINCIPAL COMPONENT ANALYSIS; PCA;
D O I
10.1016/j.patcog.2013.01.018
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Principal Component Analysis (PCA) is one of the well-known linear dimensionality reduction techniques in the literature. Large computational requirements of PCA and its insensitivity to 'local' variations in patterns motivated to propose partitional based PCA approaches. It is also observed that these partitioning methods are incapable of extracting 'global' information in patterns thus showing lower dimensionality reduction. To alleviate the problems faced by PCA and the partitioning based PCA methods, SubXPCA was proposed to extract principal components with global and local information. In this paper, we prove analytically that (i) SubXPCA shows its computational efficiency up to a factor of k (k >= 2) as compared to PCA and competitive to an existing partitioning based PCA method (SubPCA), (ii) SubXPCA shows much lower classification time as compared to SubPCA method, (iii) SubXPCA and SubPCA outperform PCA by a factor up to k (k >= 2) in terms of space complexity. The effectiveness of SubXPCA is demonstrated upon a UCI data set and ORL face data. (C) 2013 Elsevier Ltd. All rights reserved.
引用
收藏
页码:2169 / 2174
页数:6
相关论文
共 18 条
  • [1] [Anonymous], UCI REPOSITORY MACHI
  • [2] Subpattern-based principle component analysis
    Chen, SC
    Zhu, YL
    [J]. PATTERN RECOGNITION, 2004, 37 (05) : 1081 - 1083
  • [3] Block-wise 2D kernel PCA/LDA for face recognition
    Eftekhari, Armin
    Forouzanfar, Mohamad
    Moghaddam, Hamid Abrishami
    Alirezaie, Javad
    [J]. INFORMATION PROCESSING LETTERS, 2010, 110 (17) : 761 - 766
  • [4] Eigenregions for image classification
    Fredembach, C
    Schröder, M
    Süsstrunk, S
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2004, 26 (12) : 1645 - 1649
  • [5] An improved face recognition technique based on modular PCA approach
    Gottumukkal, R
    Asari, VK
    [J]. PATTERN RECOGNITION LETTERS, 2004, 25 (04) : 429 - 436
  • [6] Johnson R. A., 2001, APPL MULTIVARIATE ST, P356
  • [7] SubXPCA and a generalized feature partitioning approach to principal component analysis
    Kumar, Kadappagari Vijaya
    Negi, Atul
    [J]. PATTERN RECOGNITION, 2008, 41 (04) : 1398 - 1409
  • [8] L1-Norm-Based 2DPCA
    Li, Xuelong
    Pang, Yanwei
    Yuan, Yuan
    [J]. IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS, 2010, 40 (04): : 1170 - 1175
  • [9] Blockwise projection matrix versus blockwise data on undersampled problems: Analysis, comparison and applications
    Liang, Zhizheng
    Xia, Shixiong
    Zhou, Yong
    Li, Youfu
    [J]. PATTERN RECOGNITION, 2011, 44 (10-11) : 2774 - 2785
  • [10] Multimodal Biometric System Using Rank-Level Fusion Approach
    Monwar, Md. Maruf
    Gavrilova, Marina L.
    [J]. IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS, 2009, 39 (04): : 867 - 878