Integrating external knowledge to supplement training data in semi-supervised learning for text categorization

被引:6
作者
Benkhalifa, M
Mouradi, A
Bouyakhf, H
机构
[1] Al Akhawayn Univ Ifrane, Sch Sci & Engn, Ifrane 53000, Morocco
[2] Mohammed V Univ, ENSIAS, Rabat, Morocco
来源
INFORMATION RETRIEVAL | 2001年 / 4卷 / 02期
关键词
semi supervised Fuzzy c Means; text categorization; vector space model; WordNet lexical database; Reuters Database;
D O I
10.1023/A:1011458711300
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Text Categorization (TC) is the automated assignment of text documents to predefined categories based on document contents. TC has been an application for many learning approaches, which prove effective. Nevertheless, TC provides many challenges to machine learning. In this paper, we suggest, for text categorization, the integration of external WordNet lexical information to supplement training data for a semi-supervised clustering algorithm which can learn from both training and test documents to classify new unseen documents. This algorithm is the "Semi-Supervised Fuzzy c-Means" (ssFCM). Our experiments use Reuters 21578 database and consist of binary classifications for categories selected from the 115 TOPICS classes of the Reuters collection. Using the Vector Space Model, each document is represented by its original feature vector augmented with external feature vector generated using WordNet. We verify experimentally that the integration of WordNet helps ssFCM improve its performance, effectively addresses the classification of documents into categories with few training documents and does not interfere with the use of training data.
引用
收藏
页码:91 / 113
页数:23
相关论文
共 35 条
[31]  
Wiener E., 1995, P 4 ANN S DOCUMENT A, P317
[32]  
YANG Y, 1994, ACM T INFORM SYST, V12, P253
[33]  
Yang Y., 1997, P 14 INT C MACH LEAR, V97, P412, DOI DOI 10.1016/J.ESWA.2008.05.026
[34]  
YANG Y, 1999, INFORM RETRIEVAL, V1, P69, DOI DOI 10.1023/A:1009982220290
[35]  
YANG YM, 1997, CMUCS97127 COMP SCI