Learning dependency translation models as collections of finite-state head transducers

被引:36
作者
Alshawi, H [1 ]
Bangalore, S [1 ]
Douglas, S [1 ]
机构
[1] AT&T Labs Res, Shannon Lab, Florham Pk, NJ 07932 USA
关键词
D O I
10.1162/089120100561629
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The paper defines weighted head transducers,finite-state machines that perform middle-out st ring transduction. These transducers are strictly more expressive than the special case of standard left-to-right finite-state transducers. Dependency transduction models are then defined as collections of weighted head transducers that are applied hierarchically A dynamic programming search algorithm is described for finding the optimal transduction of an input string with respect to a dependency transduction model. A method for automatically training a dependency transduction model from a set of input-output example strings is presented. The method first searches for hierarchical alignments of the training examples guided by correlation statistics, and then constructs the transitions of head transducers that are consistent with these alignments. Experimental results are given for applying the training method to translation from English to Spanish and Japanese.
引用
收藏
页码:45 / 60
页数:16
相关论文
共 19 条
  • [1] Aho A. V., 1972, THEORY PARSING TRANS
  • [2] Alshawi H, 1996, ICSLP 96 - FOURTH INTERNATIONAL CONFERENCE ON SPOKEN LANGUAGE PROCESSING, PROCEEDINGS, VOLS 1-4, P2360, DOI 10.1109/ICSLP.1996.607282
  • [3] ALSHAWI H, 1997, P WORKSH SPOK LANG T
  • [4] ALSHAWI H, 2000, IN PRESS PHILOS T A
  • [5] ALSHAWI H, 1998, P INT C SPOK LANG PR, P2767
  • [6] BROWN P, 1993, COMPUT LINGUIST, V16, P263
  • [7] Brown P. F., 1990, Computational Linguistics, V16, P79
  • [8] Dorr B. J., 1994, Computational Linguistics, V20, P597
  • [9] AN EFFICIENT CONTEXT-FREE PARSING ALGORITHM
    EARLEY, J
    [J]. COMMUNICATIONS OF THE ACM, 1970, 13 (02) : 94 - &
  • [10] Gale W.A., 1991, SPEECH NATURAL LANGU, P152