Challenging conventional assumptions of automated information retrieval with real users: Boolean searching and batch retrieval evaluations

被引：21

作者：

Hersh, W ^{[1
]}

Turpin, A ^{[1
]}

Price, S ^{[1
]}

Kraemer, D ^{[1
]}

Olson, D ^{[1
]}

Chan, B ^{[1
]}

Sacherek, L ^{[1
]}

机构：

[1] Oregon Hlth Sci Univ, Div Med Informat & Outcomes Res, Portland, OR 97201 USA

来源：

INFORMATION PROCESSING & MANAGEMENT | 2001年 / 37卷 / 03期

关键词：

information retrieval (IR); evaluation; user studies; Text Retrieval Conference (TREC);

D O I：

10.1016/S0306-4573(00)00054-6

中图分类号：

TP [自动化技术、计算机技术];

学科分类号：

0812 ;

摘要：

Two common assumptions held by information retrieval researchers are that searching using Boolean operators is inferior to natural language searching and that results from batch-style retrieval evaluations are generalizable to the real-world searching. We challenged these assumptions in the Text Retrieval Conference (TREC) interactive track, with real users following a consensus protocol to search for an instance recall task. Our results showed that Boolean and natural language searching achieved comparable results and that the results from batch evaluations were not comparable to those obtained in experiments with real users. (C) 2001 Elsevier Science Ltd. All rights reserved.

引用

页码：383 / 402

页数：20

共 33 条

[1]

ALLEN B, 1992, P 15 ANN INT ACM SPE

[2]

[Anonymous], P 17 ANN ACM SIGIR C

[3]

[Anonymous], 1994, MANAGING GIGABYTES C

[4]

Chin J., 1988, CHI 88 P SIGCHI C HU, DOI DOI 10.1145/57167.57203

[5]

CLEVERDON C, 1966, DESIGN, V1

[6]

CLEVERDON C, 1966, RESULTS, V2

[7]

DUMAIS ST, 1991, PROCEEDINGS OF THE HUMAN FACTORS SOCIETY 35TH ANNUAL MEETING, VOL 1, P398

[8]

GOMEZ LM, 1986, HUMAN COMPUTER INTER, V2, P1

[9]

HARMAN D, 1993, ACM SPECIAL INTEREST, P38

[10]

Hersh W, 1996, J AM SOC INFORM SCI, V47, P50, DOI 10.1002/(SICI)1097-4571(199601)47:1<50::AID-ASI5>3.0.CO

← 1 2 3 4 →