Enhancing Cluster Labeling Using Wikipedia

被引:74
作者
Carmel, David [1 ]
Roitman, Haggai [1 ]
Zwerdling, Naama [1 ]
机构
[1] IBM Res Lab, IL-31905 Haifa, Israel
来源
PROCEEDINGS 32ND ANNUAL INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL | 2009年
关键词
Cluster labeling; Wikipedia;
D O I
10.1145/1571941.1571967
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This work investigates cluster labeling enhancement by utilizing Wikipedia, the free on-line encyclopedia. We describe a general framework for cluster labeling that extracts candidate labels from Wikipedia in addition to important terms that are extracted directly from the text. The "labeling quality" of each candidate is then evaluated by several independent judges and the top evaluated candidates are recommended for labeling. Our experimental results reveal that the Wikipedia labels agree with manual labels associated by humans to a cluster, much more than with significant terms that are extracted directly from the text. We show that in most cases even when human's associated label appears in the text, pure statistical methods have difficulty in identifying them as good descriptors. Furthermore, our experiments show that for more than 85% of the clusters in our test collection, the manual label (or an inflection, or a synonym of it) appears in the top five labels recommended by our system.
引用
收藏
页码:139 / 146
页数:8
相关论文
共 21 条
[1]  
[Anonymous], 2007, IJCAI
[2]  
[Anonymous], 2008, International Conference on Research and Development in Information Retrieval, DOI [10.1145/, DOI 10.1145/1390334.1390367]
[3]  
[Anonymous], OPEN DIRECTORY PROJE
[4]  
Brants Thorsten., 2006, WEB IT 5 GRAM VERSIO
[5]  
Carmel D., 2006, Proceedings of the Twenty-Ninth Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, P390, DOI 10.1145/1148170.1148238
[6]  
CHIN S, 2006, WI 06, P1046
[7]  
Christopher Manning D., 2008, INTRO INFORM RETRIEV
[8]   The Google similarity distance [J].
Cilibrasi, Rudi L. ;
Vitanyi, Paul M. B. .
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2007, 19 (03) :370-383
[9]  
CUTTING DR, 1992, SIGIR 92 : PROCEEDINGS OF THE FIFTEENTH ANNUAL INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, P318
[10]  
DEWINTER W, 2007, ICWSM 07, P251