Measuring retrieval effectiveness: A new proposal and a first experimental validation

被引：18

作者：

Della Mea, V ^{[1
]}

Mizzaro, S ^{[1
]}

机构：

[1] Univ Udine, Dept Math & Comp Sci, I-33100 Udine, Italy

来源：

JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGY | 2004年 / 55卷 / 06期

关键词：

D O I：

10.1002/asi.10408

中图分类号：

TP [自动化技术、计算机技术];

学科分类号：

0812 ;

摘要：

Most common effectiveness measures for information retrieval systems are based on the assumptions of binary relevance (either a document is relevant to a given query or it is not) and binary retrieval (either a document is retrieved or it is not). In this article, these assumptions are questioned, and a new measure named ADM (average distance measure) is proposed, discussed from a conceptual point of view, and experimentally validated on Text Retrieval Conference (TREC) data. Both conceptual analysis and experimental evidence demonstrate ADM's adequacy in measuring the effectiveness of information retrieval systems. Some potential problems about precision and recall are also highlighted and discussed.

引用

页码：530 / 543

页数：14

共 47 条

[1] BOOKSTEIN A, 1979, J AM SOC INFORM SCI, V30, P269, DOI 10.1002/asi.4630300505
[2] Borlund P., 1998, Proceedings of the 21st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, P324, DOI 10.1145/290941.291019
[3] BRUCE HW, 1994, J AM SOC INFORM SCI, V45, P142, DOI 10.1002/(SICI)1097-4571(199404)45:3<142::AID-ASI4>3.0.CO
[4] 2-6
[5] Buckley C., 2000, P 23 ANN INT ACM SIG, P33, DOI DOI 10.1145/345508.345543
[6] BUCKLEY C, 2002, P ANN INT ACM C RES, P316
[7] Burgin R, 1999, J AM SOC INFORM SCI, V50, P181, DOI 10.1002/(SICI)1097-4571(1999)50:2<181::AID-ASI8>3.0.CO
[8] 2-9
[9] COOPER WS, 1994, P 17 ANN INT ACM SIG, P243
[10] EISENBERG M, 1987, P AM SOC INFORM SCI, P66

← 1 2 3 4 5 →