Academic Commons

Presentations (Communicative Events)

Where's the Verb? Correcting Machine Translation During Question Answering

Ma, Wei-Yun; McKeown, Kathleen; Parton, Kristen; Coyne, Bob; Diab, Mona; Grishman, Ralph; Hakkani-Tür, Dilek; Harper, Mary; Ji, Heng; Ma, Wei Yun; Meyers, Adam; Stolbach, Sara; Sun, Ang; Tur, Gokhan; Xu, Wei; Yaman, Sibel

Cross-lingual tasks are especially difficult due to the compounding effect of errors in language processing and errors in machine translation (MT). In this paper, we present an error analysis of a new cross-lingual task: the 5W task, a sentence-level understanding task
which seeks to return the English 5W's (Who, What, When, Where and Why) corresponding to a Chinese sentence. We analyze systems
that we developed, identifying specific problems in language processing and MT that cause errors. The best cross-lingual 5W system was still 19% worse than the best monolingual 5W system, which shows that MT significantly degrades sentence-level understanding. Neither source-language nor targetlanguage analysis was able to circumvent problems in MT, although each approach had
advantages relative to the other. A detailed error analysis across multiple systems suggests directions for future research on the
problem.

Subjects

Files

More About This Work

Academic Units
Computer Science
Published Here
April 29, 2013