Machine learning for Arabic text categorization

被引:26
作者
Duwairi, Rehab M. [1 ]
机构
[1] Jordan Univ Sci & Technol, Dept Comp Informat Syst, Irbid, Jordan
来源
JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGY | 2006年 / 57卷 / 08期
关键词
D O I
10.1002/asi.20360
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this article we propose a distance-based classifier for categorizing Arabic text. Each category is represented as a vector of words in an m-dimensional space, and documents are classified on the basis of their closeness to feature vectors of categories. The classifier, in its learning phase, scans the set of training documents to extract features of categories that capture inherent category-specific properties; in its testing phase the classifier uses previously determined category-specific features to categorize unclassified documents. Stemming was used to reduce the dimensionality of feature vectors of documents. The accuracy of the classifier was tested by carrying out several categorization tasks on an in-house collected Arabic corpus. The results show that the proposed classifier is very accurate and robust.
引用
收藏
页码:1005 / 1010
页数:6
相关论文
共 22 条
[11]   On machine learning methods for Chinese document categorization [J].
He, J ;
Tan, AH ;
Tan, CL .
APPLIED INTELLIGENCE, 2003, 18 (03) :311-322
[12]  
HILAL Y, 1990, AR LANG PROC US COMP
[13]   Automatic textual document categorization based on generalized instance sets and a metamodel [J].
Lam, W ;
Han, YQ .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2003, 25 (05) :628-633
[14]  
LEWIS DD, 1995, 18 ACM INT C RES DEV, P246
[15]  
LI T, 2003, CIKM 03 C NEW ORL LA
[16]  
MERETAKIS D, 2000, 9 ACM INT C INF KNOW
[17]   Augmenting naive Bayes classifiers with statistical language models [J].
Peng, FC ;
Schuurmans, D ;
Wang, SJ .
INFORMATION RETRIEVAL, 2004, 7 (3-4) :317-345
[18]  
RAHAL I, 2004, ACM S APPL COMP NIC
[19]  
Ruiz ME, 1999, SIGIR'99: PROCEEDINGS OF 22ND INTERNATIONAL CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, P281, DOI 10.1145/312624.312700
[20]  
SAWAF H, 2001, AR NAT LANG PROC WOR