Utilizing Knowledge Graphs for Neural Machine Translation Augmentation

被引:12
作者
Moussallem, Diego [1 ]
Ngomo, Axel-Cyrille Ngonga [1 ]
Buitelaar, Paul [2 ]
Arcan, Mihael [2 ]
机构
[1] Paderborn Univ, Data Sci Res Grp, Paderborn, Germany
[2] Natl Univ Ireland Galway, Data Sci Inst, Insight Ctr Data Analyt, Galway, Ireland
来源
PROCEEDINGS OF THE 10TH INTERNATIONAL CONFERENCE ON KNOWLEDGE CAPTURE (K-CAP '19) | 2019年
基金
爱尔兰科学基金会; 欧盟地平线“2020”;
关键词
Neural Machine Translation; Knowledge Graphs; NLP; Linked Data;
D O I
10.1145/3360901.3364423
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
While neural networks have led to substantial progress in machine translation, their success depends heavily on large amounts of training data. However, parallel training corpora are not always readily available. Moreover, out-of-vocabulary words-mostly entities and terminological expressions-pose a difficult challenge to Neural Machine Translation systems. Recent efforts have tried to alleviate the data sparsity problem by augmenting the training data using different strategies, such as external knowledge injection. In this paper, we hypothesize that knowledge graphs enhance the semantic feature extraction of neural models, thus optimizing the translation of entities and terminological expressions in texts and consequently leading to better translation quality. We investigate two different strategies for incorporating knowledge graphs into neural models without modifying the neural network architectures. Additionally, we examine the effectiveness of our augmented models on domain-specific texts and ontologies. Our knowledge-graph-augmented neural translation model, dubbed KG-NMT, achieves significant and consistent improvements of +3 BLEU, METEOR and chrF3 on average on the newstest datasets between 2015 and 2018 for the WMT English-German translation task.
引用
收藏
页码:139 / 146
页数:8
相关论文
共 48 条
  • [1] [Anonymous], 2017, P KNOWL CAPT C K CAP
  • [2] [Anonymous], 2002, P 40 ANN M ASS COMP
  • [3] [Anonymous], 2017, P 15 C EUR CHAPT ASS
  • [4] [Anonymous], 2017, P 1 WORKSH NEUR MACH
  • [5] [Anonymous], 2018, P C N AM CHAPT ASS C, DOI DOI 10.18653/V1/N18-1029
  • [6] [Anonymous], 2005, P 10 MACH TRANSL SUM
  • [7] [Anonymous], NIPS 2017 AKBC WORKS
  • [8] [Anonymous], 1991, KBMT PROJECT CASE ST
  • [9] [Anonymous], P 27 INT C COMP LING
  • [10] [Anonymous], P 2 C MACH TRANSL