Finding needles in the haystack: Search and candidate generation

被引:9
作者
Chu-Carroll, J. [1 ]
Fan, J. [1 ]
Boguraev, B. K. [1 ]
Carmel, D. [2 ]
Sheinwald, D. [2 ]
Welty, C. [1 ]
机构
[1] IBM Corp, Div Res, Thomas J Watson Res Ctr, Yorktown Hts, NY 10598 USA
[2] IBM Res Div, Haifa Res Lab, IL-31905 Haifa, Israel
关键词
D O I
10.1147/JRD.2012.2186682
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
080201 [机械制造及其自动化];
摘要
A key phase in the DeepQA architecture is Hypothesis Generation, in which candidate system responses are generated for downstream scoring and ranking. In the IBM Watson (TM) system, these hypotheses are potential answers to Jeopardy!(TM) questions and are generated by two components: search and candidate generation. The search component retrieves content relevant to a given question from Watson's knowledge resources. The candidate generation component identifies potential answers to the question from the retrieved content. In this paper, we present strategies developed to use characteristics of Watson's different knowledge sources and to formulate effective search queries against those sources. We further discuss a suite of candidate generation strategies that use various kinds of metadata, such as document titles or anchor texts in hyperlinked documents. We demonstrate that a combination of these strategies brings the correct answer into the candidate answer pool for 87.17% of all the questions in a blind test set, facilitating high end-to-end question-answering performance.
引用
收藏
页数:12
相关论文
共 34 条
[1]
Ahn David., 2004, P TEXT RETRIEVAL C
[2]
[Anonymous], IBM J RES DEV
[3]
[Anonymous], 1991, Artificial Intelligence
[4]
[Anonymous], 2007, Proceedings of human language technology conference of the North American chapter of the association of computational linguistics
[5]
[Anonymous], 2004, Lucene in Action
[6]
[Anonymous], IBM J RES DEV
[7]
Carmel D., 2002, Proceedings of SIGIR 2002. Twenty-Fifth Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, P283, DOI 10.1145/564376.564427
[8]
Chu-Carroll J., 2012, IBM J RES DEV, V56, P4
[9]
Chu-Carroll J., 2011, P 25 C AAAI, P872
[10]
Chu- Carroll Jennifer, 2012, IBM J RES DEV, V56