The impact on retrieval effectiveness of skewed frequency distributions

被引:9
作者
Sanderson, M [1 ]
van Rijsbergen, CJ
机构
[1] Univ Sheffield, Dept Informat Studies, Sheffield S10 2TN, S Yorkshire, England
[2] Univ Glasgow, Dept Comp Sci, Glasgow G12 8QQ, Lanark, Scotland
关键词
experimentation; measurement; pseudowords; word sense ambiguity; word sense disambiguation;
D O I
10.1145/326440.326447
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
We present an analysis of word senses that provides a Fresh insight into the impact of word ambiguity on retrieval effectiveness with potential broader implications for other processes of information retrieval. Using a methodology of forming artificially ambiguous words, known as pseudowords, and through reference to other researchers' work, the analysis illustrates that the distribution of the frequency of occurrence of the senses of a word plays a strong role in ambiguity's impact on effectiveness. Further investigation shows that this analysis may also be applicable to other processes of retrieval, such as Cross Language Information Retrieval, query expansion, retrieval of OCR'ed texts, and stemming. The analysis appears to provide a means of explaining, at least in part, reasons for the processes' impact (or lack of it) on effectiveness.
引用
收藏
页码:440 / 465
页数:26
相关论文
共 39 条
  • [31] VANRIJSBERGEN CJ, 1979, INFORMATION RETRIEVA
  • [32] VOORHEES E, 1996, P 5 TEXT RETR C
  • [33] Voorhees E. M., 1994, P 17 ANN INT ACM SIG, P61
  • [34] VOORHEES EM, 1993, P 16 ANN INT ACM SIG, P171, DOI DOI 10.1145/160688.160715
  • [35] WALLIS P, 1993, P 1 PACL C
  • [36] LEARNING TO DISAMBIGUATE
    WEISS, SF
    [J]. INFORMATION STORAGE AND RETRIEVAL, 1973, 9 (01): : 33 - 41
  • [37] NUCLEOTIDE POOLS IN WILD-TYPE AND DEOXYCYTIDINE KINASE-DEFICIENT FRIEND MURINE ERYTHROLEUKEMIA-CELLS
    WILKINSON, YA
    BOUILLER, BA
    MCKENNA, PG
    [J]. MUTAGENESIS, 1990, 5 (01) : 99 - 100
  • [38] Corpus-based stemming using cooccurrence of word variants
    Xu, JX
    Croft, WB
    [J]. ACM TRANSACTIONS ON INFORMATION SYSTEMS, 1998, 16 (01) : 61 - 81
  • [39] YAROWSKY D, 1993, P ARPA HUM LANG TECH