Nearest-Neighbor Guided Evaluation of Data Reliability and Its Applications

被引:54
作者
Boongoen, Tossapon [1 ]
Shen, Qiang [1 ]
机构
[1] Aberystwyth Univ, Dept Comp Sci, Aberystwyth SY23 3DB, Dyfed, Wales
来源
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS | 2010年 / 40卷 / 06期
基金
英国工程与自然科学研究理事会;
关键词
Alias detection; data reliability; nearest neighbor; ordered weighted averaging (OWA) aggregation; unsupervised feature selection; weight determination; FEATURE-SELECTION; DIMENSIONALITY REDUCTION; CONSENSUS; ALGORITHMS; SEARCH;
D O I
10.1109/TSMCB.2010.2043357
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The intuition of data reliability has recently been incorporated into the main stream of research on ordered weighted averaging (OWA) operators. Instead of relying on human-guided variables, the aggregation behavior is determined in accordance with the underlying characteristics of the data being aggregated. Data-oriented operators such as the dependent OWA (DOWA) utilize centralized data structures to generate reliable weights, however. Despite their simplicity, the approach taken by these operators neglects entirely any local data structure that represents a strong agreement or consensus. To address this issue, the cluster-based OWA (Clus-DOWA) operator has been proposed. It employs a cluster-based reliability measure that is effective to differentiate the accountability of different input arguments. Yet, its actual application is constrained by the high computational requirement. This paper presents a more efficient nearest-neighbor-based reliability assessment for which an expensive clustering process is not required. The proposed measure can be perceived as a stress function, from which the OWA weights and associated decision-support explanations can be generated. To illustrate the potential of this measure, it is applied to both the problem of information aggregation for alias detection and the problem of unsupervised feature selection (in which unreliable features are excluded from an actual learning process). Experimental results demonstrate that these techniques usually outperform their conventional state-of-the-art counterparts.
引用
收藏
页码:1622 / 1633
页数:12
相关论文
共 69 条
[1]  
[Anonymous], 1997, The Ordered Weighted Averaging Operation: Theory, Methodology and Applications
[2]  
[Anonymous], 2007, Uci machine learning repository
[3]  
[Anonymous], 1998, Feature Extraction, Construction and Selection: A Data Mining Perspective
[4]  
Beliakov G., 2007, Aggregation Functions: A Guide for Practitioners, DOI DOI 10.1007/978-3-540-73721-6
[5]  
Bishop CM., 1995, NEURAL NETWORKS PATT
[6]   Selection of relevant features and examples in machine learning [J].
Blum, AL ;
Langley, P .
ARTIFICIAL INTELLIGENCE, 1997, 97 (1-2) :245-271
[7]  
BOONGOEN T, AI LAW IN PRESS, DOI DOI 10.1007/S10506-010-9085-9
[8]   Clus-DOWA: A New Dependent OWA Operator [J].
Boongoen, Tossapon ;
Shen, Qiang .
2008 IEEE INTERNATIONAL CONFERENCE ON FUZZY SYSTEMS, VOLS 1-5, 2008, :1057-1063
[9]   An improved branch and bound algorithm for feature selection [J].
Chen, XW .
PATTERN RECOGNITION LETTERS, 2003, 24 (12) :1925-1933
[10]  
Dash M., 1997, Intelligent Data Analysis, V1