Time-aware evidence ranking for fact-checking

被引:8
作者
Allein, Liesbeth [1 ,2 ]
Augenstein, Isabelle [3 ]
Moens, Marie-Francine [2 ]
机构
[1] European Commiss, Joint Res Ctr JRC, Ispra, Italy
[2] Katholieke Univ Leuven, Dept Comp Sci, Celestijnenlaan 200A, B-3001 Leuven, Belgium
[3] Univ Copenhagen, Dept Comp Sci, Univ Pk 1, DK-2100 Copenhagen, Denmark
来源
JOURNAL OF WEB SEMANTICS | 2021年 / 71卷 / 71期
关键词
Automated fact-checking; Temporal relevance; Temporal semantics; Document ranking; Learning to rank; VERIFIER;
D O I
10.1016/j.websem.2021.100663
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Truth can vary over time. Fact-checking decisions on claim veracity should therefore take into account temporal information of both the claim and supporting or refuting evidence. In this work, we investigate the hypothesis that the timestamp of a Web page is crucial to how it should be ranked for a given claim. We delineate four temporal ranking methods that constrain evidence ranking differently and simulate hypothesis-specific evidence rankings given the evidence timestamps as gold standard. Evidence ranking in three fact-checking models is ultimately optimized using a learning-to-rank loss function. Our study reveals that time-aware evidence ranking not only surpasses relevance assumptions based purely on semantic similarity or position in a search results list, but also improves veracity predictions of time-sensitive claims in particular. (C) 2021 The Author(s). Published by Elsevier B.V.
引用
收藏
页数:14
相关论文
共 32 条
  • [1] Augenstein I, 2019, 2019 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING AND THE 9TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING (EMNLP-IJCNLP 2019), P4685
  • [2] Bansal Rakshita, 2019, Emerging Research in Computing, Information, Communication and Applications. ERCICA 2018. Advances in Intelligent Systems and Computing (AISC 906), P251, DOI 10.1007/978-981-13-6001-5_19
  • [3] Temporal Feedback for Tweet Search with Non-Parametric Density Estimation
    Efron, Miles
    Lin, Jimmy
    He, Jiyin
    de Vries, Arjen
    [J]. SIGIR'14: PROCEEDINGS OF THE 37TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, 2014, : 33 - 42
  • [4] Halpin T, 2008, LECT NOTES COMPUT SC, V5333, P688
  • [5] Hanselowski Andreas, 2018, P 1 WORKSHOP FACT EX, P103
  • [6] Hidey Christopher, 2020, P 58 ANN M ASS COMP, P8593, DOI 10.18653/v1/2020.acl-main.761
  • [7] Temporal Information Retrieval
    Kanhabua, Nattiya
    Anand, Avishek
    [J]. SIGIR'16: PROCEEDINGS OF THE 39TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, 2016, : 1235 - 1238
  • [8] A Survey on Temporal Reasoning for Temporal Information Extraction from Text
    Leeuwenberg, Artuur
    Moens, Marie-Francine
    [J]. JOURNAL OF ARTIFICIAL INTELLIGENCE RESEARCH, 2019, 66 : 341 - 380
  • [9] Leeuwenberg A, 2018, 2018 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP 2018), P1237
  • [10] Li X., 2003, P 12 INT C INF KNOWL, P469, DOI DOI 10.1145/956863.956951